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Preface 



There are some topics in mathematics which, though en- 
joying a certain fame, have traditionally been considered 
either too complicated or of insufficient importance to be 
included in the core mathematical curriculum. Customarily, 
such subjects are relegated to optional units of the syllabus, 
independent study projects, seminar papers, and math club 
talks. Among such topics are several which remain in this 
nebulous status only because of inertia. An example is Go- 
del's incompleteness theorem. 

Although very many mathematicians (and nonmathemati- 
cians) have heard of Godel's theorem, very few could explain 
exactly what the theorem says, let alone how it is proved. 
Yet the result is so important, and the reasons for the funda- 
mental incompleteness (i.e., the impossibility of ever attain- 
ing a situation in which every true statement can be proved) 
are so simple, that Godel's theorem can be taught to 
first-year college students. Moreover, the only prerequisites 
for understanding the proof are familiarity with the termi- 
nology of set theory (the words "set," "function," "domain of 
definition" and the like) and a certain facility at understand- 
ing mathematical arguments. Thus, the proof is even ac- 
cessible to an ambitious high school student. 

The method of proving Godel's theorem in this book is 
different from Godel's own method. Our method relies upon 
elementary concepts from the theory of algorithms. All of 



the necessary background information from this theory will 
be explained as needed, so that as a by-product of the proof 
the reader will become familiar with the basic facts of the 
theory of algorithms. 

This book is based on an article I wrote in the Uspekhi 
M atematicheskikh Nauk journal, vol. 29, no. 1 (1974). Of 
course, the intended readership is quite different, so the es- 
say had to be rewritten. In particular, I have omitted discus- 
sions of more specialized questions, and also all references 
to the original publications; the curious reader can find these 
in the article mentioned above. At the same time, I have 
expanded the section on the connection between the seman- 
tic and syntactic formulations of the incompleteness theorem, 
and have added appendixes on Tarski's theorem on the 
inexpressibility of truth and on the justification of the arith- 
meticity axiom. 

The plan of the book is as follows. In Sec. 1 we state the 
incompleteness theorem and explain the precise meaning of 
each element in the statement of the theorem. In particular, 
the notion of a deductive system, which is central to the book, 
is introduced; Sec. 2 contains an informal exposition of some 
initial concepts from the theory of algorithms, which are 
then used to give our first criteria for completeness and incom- 
pleteness. In Sec. 3 we continue our study of the incomplete- 
ness criteria; and in Sec. 4 we cover the language of formal 
arithmetic, define exactly what it means for a statement in 
that language to be true, and give a precise statement of 
Godel's incompleteness theorem for formal arithmetic. Sec- 
tion 5 contains a development of the ideas concerning algo- 
rithms which were briefly described in Sec. 2, culminating 
in three axioms for the theory of algorithms. In Sec. 5 we 
complete the proof of the incompleteness theorem for formal 
arithmetic. 

The book concludes with seven appendixes, which are writ- 
ten in a somewhat more condensed style, but still without 
assuming any special knowledge. In the first appendix we 
examine the connection between the existence of true state- 
ments which cannot be proved and the existence of statements 
which cannot be either proved or disproved. In the second 
appendix we prove Tarski's theorem on the inexpressibility 
of truth, which is a strengthening of Godel's theorem. The 
third appendix is concerned with justifying one of the axi- 
oms of the theory of algorithms in Sec. 5, namely, the arith- 
flieticity axiom. For this purpose we introduce a particular 
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class of algorithms, the "address programs," and we verify 
the arithmeticity of functions which are computable by this 
class of algorithms. In the fourth appendix the completeness 
and incompleteness criteria in Sec. 2 are applied to languages 
connected with what are called "associative calculi." The 
fifth appendix describes the original formulation of the in- 
completeness theorem which Godel himself gave. The sixth 
appendix contains exercises for the preceding sections. Fi- 
nally, the last appendix gives answers and hints for these 
exercises. The appendixes are mutually independent, and so 
can be read in any order, except that Appendix C in certain 
places assumes a familiarity with some concepts from Appen- 
dix B. 

If after reading this book the reader would like to know 
more about mathematical logic and the theory of algorithms, 
he or she can turn to the books listed at the end of the book. 

Vladimir Uspensky 



1. Statement of the Problem 



The incompleteness theorem, for which we will give a 
precise statement in this section and later a proof, says 
roughly the following: under certain conditions in any lan- 
guage there exist true but unprovable statements. 

When we state the theorem this way, almost every word 
needs some explanation. Thus, we must start by explaining 
the meaning of these words. 

1.1. Language. We shall not give the most general possi- 
ble definition of a language, but rather shall limit "ourselves 
to those language concepts which we shall later need. There 
are two such concepts: the "alphabet of a language" and the 
"set of true statements in a language." 

1.1.1. Alphabet. By an alphabet we mean a finite list 
of elementary signs (i.e., things which cannot be split up 
into smaller units7.These signs are called the letters of our 
alphabet. By a word in the alphabet we mean a finite se- 
quence of letters. For example, the usual words in the English 
language (including proper names) are words in a 54-letter 
alphabet (26 small letters, 26 capital letters, the hyphen and 
apostrophe). As another example the natural numbers writ- 
ten in decimal form are words in a ten-letter alphabet whose 
letters are 0, 1, 2, 3, 4, 5, 6, 7, 8, 9. We shall use ordinary 
capital letters to denote alphabets. If L is an alphabet, then 
L°° denotes the set of all words in the alphabet L^ We shall 
assume that any language has an alphabet such that all the 
expressions in the language (i.e., the names of various objects, 
statements concerning these objects, etc.) are words in 
this alphabet. For example, any sentence in English, or in 
fact any English language text, may be regarded as a word in 
the alphabet which is obtained by expanding the 54-letter 
alphabet to include punctuation marks, a space for use be- 
tween words, a sign for paragraph indentation, and perhaps 



a few other useful signs. When we assume that the expres- 
sions in a language are words in some alphabet, we thereby 

o 

rule out "multilayered" expressions, such as f / (x) dx. But 

a 

this restriction is not very serious, because any such expres- 
sion can be "stretched out" into a linear form using suitable 
notational conventions. 

Any set M which is contained in L°° is called a word set 
in the alphabet L. If we say simply that I is a word set, 
we mean that it is a word set in some alphabet. Now the 
above assumption about a language can be rephrased as fol- 
lows: in any language the set of expressions is a word set. 

1.1.2. The Set of True Statements. We assume that we are 
given a subset T of the set L°° ^where L is the alphabet of 
the language under consideration) which is called the set 
of "true statements" (or simply "truths"). In going right to 
the subset T we are omitting such intermediate steps as: 
firstly, specifying which words of all the possible ones in the 
alphabet L are correctly formed expressions in the language, 
i.e., have a definite meaning in our interpretation of the 
language (for example, 2 + 3, x + 3, x = y, x = 3, 2 = 
3, 2 = 2 are correctly formed expressions, while + = 
x is not); secondly, which of all the expressions are formu- 
las, i.e., in our interpretation make statements which may de- 
pend on a parameter (for example, x = 3, x = y, 2 = 3, 
2 = 2); thirdly, specifying which of all the possible formu- 
las are closed formulas, i.e., statements which do not depend 
on parameters (for example, 2 = 3, 2 = 2); and finally, 
which of all the possible closed formulas are true statements 
(for example, 2 = 2). 

1.1.3. For our purposes it will be enough to consider that 
a language is completely defined as soon as we are told its 
alphabet L and the subset T of L°° We shall call any such 
(L, T) a fundamental pair. 

1.2. Unprovable. "Unprovable" means not provable, and 
"provable" means having a proof. 

1.3. Proof. Although the term "proof is perhaps the most 
important in mathematics*, it does not have an exact defi- 
nition. The full notion of a proof, with all its ramifications, 



* Bourbaki begins his Foundations of Mathematics with the words, 
"From the time of the Greeks, to say 'mathematics' l*as meant %\\e 
same as to say * proof/" 



belongs as much to the realm of psychology as to mathemat- 
ics. After all, a proof is simply an argument which we find 
so convincing that we are ready to use it to convince others. 

1.3.1. When written down, a proof becomes a word in 
some alphabet P, just as English language texts are words in 
an alphabet L, as mentioned above. All proofs comprise a 
subset (a rather wide-ranging subset, to be sure) of P°°. 
We shall not attempt to give a precise definition for this 
"naive" and "absolute" concept of proof, or, equivalently, 
for the corresponding subset of P°°. Instead, we shall study 
a formal analog of this notion of proof, for which we shall 
still use the term "proof." This analog has two essential fea- 
tures which are different from the intuitive notion (though 
the intuitive idea of a proof reflects these features to some 
degree). In the first place, we shall allow different concepts 
of proof, i.e., different proof-subsets of P°°, and, in fact, 
we shall also allow the alphabet P to vary. In the second 
place, for each such concept of proof we shall require that 
there be an effective method, or algorithm (a precise defini- 
tion of this term will be given in Sec. 2), which verifies 
whether or not a given word in the alphabet P is a proof. We 
shall also assume that there is an algorithm which, given a 
proof, determines what statement it proves. (In many situa- 
tions, the statement being proved is simply the last state- 
ment in the sequence of steps which make up the proof.) 

1.3.2. Thus, our final definition is as follows: 

1°. We have an alphabet L (the language alphabet) and 
an alphabet P (the proof alphabet). 

2°. In the set P°° we are given a subset P, whose elements 
are called proofs. We further assume that we have an algo- 
rithm which, given an arbitrary word in the alphabet P, 
enables us to determine whether or not it belongs to P. 

3°. We have a function 5 (to determine what is being proved) 
whose domain of definition A satisfies P g A g P°° and 
whose range of values is in L°° We assume that we have an 
algorithm which computes this function (the precise meaning 
of the words "an algorithm computes a function" will be ex- 
plained in Sec. 2). We shall say that an element p of P is a 
proof of the word 8 (p) in the language alphabet L. 

1.3.3. A triple (P, P, 6) which satisfies conditions 1°- 
3° is called a deductive system over the alphabet L. 

1.3.4. For the benefit of the reader who is familiar with the 
usual way of characterizing a "proof" in terms of "axioms" 
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and "rules of deduction," we now explain how this method 
can be regarded as a special case of the definition in Subsec. 
1.3.2. That is, a proof is usually defined to be a sequence of 
expressions in a language such that each term either is an 
axiom or else is obtained from the earlier terms using one 
of the rules of deduction. If we add a new letter * to our lan- 
guage alphabet, we can write out such a proof as a word in 
the resulting alphabet: a sequence of expressions (C r , C 2 , . . 
. . ., C n ) becomes the word C t *C 2 * . . *C n , The function 
which determines what is being proved simply takes from 
such a word the part that follows the last *. The algorithms 
required by the definition in Subsec. 1.3.2 can easily be con- 
structed once we specify any of the customary meanings of 
"axiom" and "rules of deduction." 

1.4. Attempts at a Precise Formulation of the Incom- 
pleteness Theorem. 

1.4.1. First Attempt. "Under certain conditions, given a 
fundamental pair (L, T) and a deductive system (P, P, 6) 
over L, there always exists a word in T which does not have 
a proof." This statement is still too vague. In particular, we 
could obviously think up many deductive systems having 
very few provable words. For example, there are no provable 
words at all in the empty deductive system (where P = 0). 

1.4.2. Second Attempt. There is another more natural ap- 
proach. Suppose we are given a language, in the precise mean- 
ing that we are given a fundamental pair (L, T). We now 
look for a deductive system over L (intuitively, we look for 
techniques of proof) in which we can prove as many words in 
T as possible, ideally, all words in T. Godel's theorem de- 
scribes a situation in which such a deductive system (in which 
every word of T has a proof) does not exist. Thus, we would 
like to make the following statement: "Under certain 
conditions concerning the fundamental pair (L, T) there 
does not exist a deductive system over L in which every 
word in T has a proof." However, this statement is clearly 
false, since one need only take the deductive system with 
P = L, P = P°° and 8 (p) = p for all p in P°°; then every 
word in L°° is trivially provable. Thus, we need a restric- 
tion on the deductive systems that we are allowed to use. 

1.5. Consistency. It is natural to require that only "true 
statements," i.e., words in T, can be proved. We say that a 
deductive system (P, P, 8) is consistent relative to (or for) 
the fundamental pair (L, T) if we have 8 (P) <= T. In what 
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follows, we shall only be interested in consistent deductive 
systems. If we have a language, it is very tempting to try 
to find a consistent deductive system in which every true 
statement is provable. The version of Godel's theorem which 
we shall study states precisely that, under certain conditions 
concerning the fundamental pair, it is impossible to find 
such a deductive system. 

1.6. Completeness. We say that a deductive system (P, P, 6) 
is complete relative to (or for) the fundamental pair (L, T) 
if we have 5 (P) ^ T. Our statement of the incompleteness 
theorem now takes the following form: 

under certain conditions concerning the fundamental pair 
(L, Z 7 ), there does not exist any deductive system over L which 
is both complete and consistent relative to (L, T). 

For now we shall be satisfied with this formulation. In 
later sections we shall specify the conditions which the fun- 
damental pair must satisfy. 

2, Basic Concepts from the Theory 
of Algorithms and Their Application 

Conditions for the nonexistence of a complete and consis- 
tent deductive system can easily be given in terms of the 
theory of algorithms. 

For now, we shall only need the most general intuitive 
idea of what an algorithm is: a set of instructions which, 
given an input (also called the initial data or the argument) 
from some set of possible inputs (for the given algorithm), 
enables us to obtain an output if such an output exists or else 
obtain nothing at all if there is no output for our particular 
input. Notice that the set of possible inputs consists of all 
inputs to which the algorithm can be applied, not only those 
for which the algorithm gives an output. If there is an output 
for a particular input, then we say that the algorithm can be 
applied to this input and processes it to give the corresponding 
output. 

For our purposes, in order to avoid unnecessary digres- 
sions, we shall suppose that the inputs and outputs of an 
algorithm are words. More precisely: every algorithm has an 
input alphabet, so that all possible inputs are words in this 
alphabet, and an output alphabet, so that all outputs are 
words in this output alphabet. This means, for example, 
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that in order io work with algorithms which process pail's 
or sequences of words, we must first write such pairs or se- 
quences as single words in a new alphabet. To be definite, 
whenever we have an alphabet L we shall agree to let a star 
stand for a new letter not in our alphabet L (thus, the star 
denotes different letters in different situations). We shall 
let L* denote the alphabet obtained by adding the star sym- 
bol to our original alphabet L. In Subsec. 1.3.4 we already 
agreed to write a sequence of words (C l7 . . ., C n ) in the al- 
phabet L as the single word C 1 * . . * C n in the alphabet 
Lj.. For example, a pair (C x , C 2 ) will be written as C^C 2 
in the alphabet L*. 

Furthermore, suppose that for fixed n we have a set of n 
alphabets L lt L 2 , . , L n . We then let * denote a letter that 
is not in any of the alphabets L z «, and we write a sequence 
(C x , . . ., C n ) in which each C t is a word in the corresponding 
alphabet Lj, as the single word C x * *C n in the alpha- 

bet (L x U L 2 U . - . U Ln)*- We shall let L" X . X L~ 
denote the set of all such sequences of n words in the respec- 
tive alphabets, or equivalently, the set of corresponding 
single words formed using the star symbol. 

The set of all inputs that can be processed by a given al- 
gorithm is called the domain of applicability of the algo- 
rithm. Any algorithm defines a function, namely, the func- 
tion which associates the corresponding output to every 
element in the domain of applicability. Thus, the domain 
of definition of this function is precisely the domain of applic- 
ability of the algorithm. We say that the algorithm com- 
putes the function that is defined in this way. 

We shall let A (x) denote the output obtained by applying 
the algorithm A to the input x, and for brevity we write 
A ((x^ x 2 , . ., x n )) simply as A (x t1 x 2 , , x n ). Then the 

definition of the term "computes" can be rephrased as fol- 
lows: the algorithm A computes the function / if we have 
A (x) ~ f (x) for all x. Here ~ is the "conditional equality" 
sign, which is defined as follows: A ~ B either if A and B 
are both undefined, or if A and B are both defined and are 
the same. 

A function which can be computed by some algorithm is 
called a computable function. Thus, in part 3° of the defini- 
tion of a proof (see Subsec. 1.3.2) we are saying that the 
function which yields the statement being proved must be a 
computable function. 

Because of our assumptions about the meaning of an algo- 
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rithm, for every computable function we must have two al- 
phabets such that all possible arguments of the function are 
words in the first alphabet and all possible values of the 
function are words in the second alphabet. 

We are especially interested in functions whose arguments 
and values are natural numbers (we shall always include 
zero in the natural numbers). Such functions are called 
numerical functions. In order to be able to speak of computa- 
ble numerical functions, we must introduce algorithms which 
deal with numbers, and to do this we must first of all repre- 
sent the natural numbers as words in some alphabet, called 
a digital alphabet. There are various ways of doing this, for 
example: (1) the binary system, in which numbers are writ- 
ten in the alphabet (0, 1}; (2) the decimal system, which 
uses the alphabet {0, 1, 2, 3, 4, 5, 6, 7, 8, 9}; (3) the system 
using a one-letter alphabet { | } with the number n written 
as the word || | (repeated n times); (4) the system in 

which n is written as the word ( || . . | ) (where | is repeat- 
ed n times) in the three-letter alphabet {!,(,)}; and so 
on. We simply choose the most convenient system for our 
particular purposes. Each symbol for a number (in some fixed 
system) is called a digit. When we speak of algorithms and 
computable functions which process numbers, strictly speak- 
ing we shall mean algorithms and computable functions 
which process the digits used to write these numbers (in 
some chosen notational system). 

Thus, the notion of a computable numerical function seems 
to depend upon our choice of notational system for writ- 
ing numbers. However, it is easy to show that a numerical 
function which is computable in one notational system will 
be computable in any other, at least for a large class of 
notational systems. We shall say that two notational sys- 
tems are equivalent if there exist an algorithm which pro- 
cesses an arbitrary number written in the first system and gives 
as output the same number written in the second system, 
and also an algorithm which processes a number written in 
the second system and gives as output the same number writ- 
ten in the first system. The examples of notational systems 
given above are obviously mutually equivalent. 

We now show that a numerical function / which is compu- 
table in one notational system will also be computable in any 
equivalent notational system. Let C and D be algorithms 
which translate from the first notational system to the 
second and conversely, and let A be an algorithm which com- 
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enumerable but nondecidable subset of the set of natural 
numbers. The next lemma gives a condition for an enumera- 
ble set to be decidable. 

Lemma 3. A subset S of an enumerable set X is decidable 
relative to X if and only if both S and its complement X \ S 
are enumerable. 

^ If S is decidable, then so is X \ S, and so both S and 
X \ S are enumerable, by Lemma 2. Conversely, suppose 
that both S and X \ S are enumerable. If either one is emp- 
ty, then S is decidable, by Lemma 1. Suppose that both S 
and X \ S are nonempty, in which case they are enumerat- 
ed by some computable functions / and g, respectively. 
Then, if we want to answer the question "Does x belong to 
£?" for an arbitrary x in X, we need only compute succes- 
sively 

/(0), *(0), /(l), g(i), /(2), g(2), 

until we encounter x. Note that x must eventually occur, 
since the above sequence exhausts all of X. If x occurs 
among the values of /, then x belongs to S\ if x occurs among 
the values of g, then x does not belong to S. ■ 

Theorem 2. The set of all proofs (for a given deductive system) 
is enumerable. 

^ The set of all words in the proof alphabet is enumerable 
(see Example 2 above). Hence the theorem follows from Lem- 
ma 2. ■ 

Lemma 4 (the image of an enumerable set). Suppose that 
R is an enumerable set and f is a computable function which 
is defined on all elements of R. Then f (R) is an enumerable 
set. 

► If i? is empty, then so is / (R). If R is enumerated by 
the computable function p, then / (R) is enumerated by the 
computable function y = / (p (x)). ■ 

Example 5. Let "~| be a symbol in some alphabet L, and 
let A ^ L°°. We let ~~]A denote the set of all words of the 
form ~\a, where a 6 A. If we set R — A and / (a) = ~\a 
in Lemma 4, we see that enumerability of A implies enu- 
merability of ~~|i4; and if we set R = "^^4 and / ( ]a) == a, 
we see that, conversely, enumerability of ~]A implies enu- 
merability of A. 

Example 6. We claim that L°° X L°° is enumerable for 
any alphabet L. In fact, the sets IN 2 and L 00 are both enu- 
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merable (see Examples 1 and 2 above). Let L°° be enumera- 
ted by the computable sequence g. We define a computable 
function / on the set IN 2 by setting / (a, b) = (g (a), g (b)). 
Obviously, / (IN 2 ) = L 00 X L°° and then our claim fol- 
lows from Lemma 4. 

As usual, we let K x X K 2 x X K n denote the direct 

product of the sets K x , K 2 , . ., K ni i.e., the set of all 
rc-tuples (k t , k 2 , k n ) such that k ± 6 Kn k 2 £ K 2 , 

. ., k n £ K n . In view of our notational convention at the 
beginning of the section, if L x , L n are alphabets and 

jfiTj ^ L~, ., K n ^ L~, then the product K x X X 

K n is a set of words in L~ X . XLJ°. 

Corollary 1 of Lemma 4. // K x , ., K n are enumerable 
sets, then so is the product K x X .X K n . 

► When ft = 2, the proof follows the argument in Example 
6 above. Then we proceed by induction, and apply Lemma 
4 to the "obvious" computable function from (K x x 

X K n ) X K n+l to K x X . X # n X K n+l . * 

The r-tuple (C it , ., C, r ), where i\ ^ n, ., i r ^ n, 

is called the projection of the rc-tuple (Cj, . ., C n ) onto the 

ij, ., i r axes, and is denoted pr fl , ., t (C ly ., C n ). In 

particular, we have pr x (C 1? . . ., C n ) = C r , pr 2 (C ly . 

C n > = C ai etc. If Af e /Tj X X # n , then we let 

pr ?l ; M denote the set of all possible projections 

pr h> t m, where m £ M> 
Corollary 2 of Lemma 4. // L x , . ., L n are alphabets, i u 
i r are positive integers not exceeding n, and M is an enu- 
merable subset of L™ X X L~, then pr fl) t M is 
enumerable. 

► It suffices to use the computable function #i-> pr, . f x. ■ 
Theorem 3. 7%e set of all provable words (for a given deduc- 
tive system) is enumerable. 

► Let Q be the set of all provable words for the deductive 
system (P, P, 8). Obviously Q = 5 (P). But P is an enumer- 
able set by Theorem 2. Hence Q is also enumerable, by 
Lemma 4. ■ 

It follows that if T is not an enumerable set, then it is 
impossible to find a complete and consistent deductive sys- 
tem for the pair (L, 7 1 ), since the set Q of provable words for 
any consistent deductive system is a proper subset of T, 
and there will have to be an element in the complement 
T \ Q. Such an element is a true but unprovable statement! 
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Theorems 1 and 3 together give a condition on a fundamen- 
tal pair which is necessary and sufficient for the existence 
of a complete and consistent deductive system for the pair. 
This condition is enumerability of the set of all truths. One 
would expect (and this is what turns out to be the case) that 
in a "rich" or "expressive" language the set of all truths is 
too complicated to be enumerable, and hence there are no 
complete and consistent deductive systems for such a lan- 
guage. However, the criterion in Theorems 1 and 3 is not very 
convenient to use, since it is often difficult to study the en- 
tire set 7\ In the next section we shall reformulate our crite- 
rion so as to make it more "applicable." 

3. The Simplest Incompleteness Criteria 

We now know that enumerability of the set T is equiva- 
lent to the existence of a complete and consistent deductive 
system for (L, T). 

However, we might be interested not in all truths in the 
language, but only in truths of a certain type or a certain 
class, much as a student studying for a math exam is not 
concerned with the truth of all mathematical statements, 
but only those which are likely to be encountered on the 
exam. For example, we might want to construct a deductive 
system in which one can derive all true statements of length 
at most 1000 and cannot derive any false statement of 
length at most 1000. In this case, for a statement of length 
greater than 1000 the question of whether or not it can be de- 
rived in the deductive system may have nothing to do with 
whether or not it is true. Moreover, in certain situations 
(such as the language of set theory), one cannot even define 
the set of all truths in their totality. This is why we restrict 
ourselves to considering consistency and completeness for 
subsets of the word set L°° We now proceed to the formal defi- 
nitions. 

Let (L, T) be a fundamental pair, let (P, P, 8) be a deduc- 
tive system over L, and let Q be the set of all provable 
words. Suppose that V ^ L°°* We say that the deductive 
system (P, P, 8> 

(a) is consistent relative to V, if V {] Q ^ V f] T; 

(b) is complete relative to V, if V fl T ^ V f] <?. 
Theorem 4. Suppose that V is an enumerable subset of L°°, 

and the set of true statements in V is not enumerable f Then ther§ 
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is no deductive system which is both consistent and complete 
relative to V. 

^ By assumption, V f] T is not enumerable. In order for a 
deductive system to be complete and consistent relative 
to V, we must have V f] T = V {] Q. But V f] Q must be enu- 
merable, because of Theorem 3 and the following lemma. ■ 
Lemma 5. The set-theoretic union or intersection of two enu- 
merable sets is enumerable. 

^ Suppose that R and S are enumerable sets. We first 
prove that R [) S is enumerable. This is trivial if one of the 
two sets is empty. If both sets are nonempty, then we have 
R = { p (0), p (1), . } and S = {o (0), o (1), .}, where 
p and a are computable sequences. Then we can enumerate 
R (J S by means of the computable sequence / defined as 
follows: / (2n) — p (n), f (2n + 1) = a (n). We now prove 
that R fl S is enumerable. If R f] S is empty, then it is 
enumerable, by definition. Otherwise there exists an a such 
that a £ R f] S. Again suppose that R and S are enumera- 
ted by the computable functions p and a. Since the set !N 2 
is enumerable (see Example 1 in Sec. 2), it is enumerated by 
some computable function £. Each value of g (n) is a pair 
of natural numbers: let us denote the two numbers in this 
pair by E (n) and r| (n). The functions £ and r\ are obviously 
computable. We introduce a function h by setting 

h(n) = \ 

[ a, otherwise. 

The function h is computable, and it enumerates the set 

r r\s. m 

Remark 7. The condition in Theorem 4 is actually neces- 
sary as well as sufficient for there not to exist a deductive 
system, which is complete and consistent relative to V 
(The necessity of this condition is even true without assum- 
ing that V is enumerable.) Namely, if V f] T is enumera- 
ble, then the complete and consistent deductive system for 
(L, V H T) which exists by Theorem 1, will also be a conv 
plete and consistent deductive svstem for (L, T) relative 
to V. 

Clearly, a deductive system is consistent (or complete) 
for (L, T) if and only if it is consistent (respectively, com- 
plete) relative to any subset of L°° Hence, if we have a 
consistent deductive system for (L T T) and want to show 
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putes the function / in the first notational system. (More pre- 
cisely, the algorithm A computes the function of digits in 
the first notational system which corresponds to /, which is 
a function of numbers.) Then the following algorithm B 
will compute / in the second notational system (more pre- 
cisely, B will compute the function of digits in the second 
notational system which corresponds to /): 

B (x) ~ CAD (x). 

That is, the set of instructions for the algorithm B can be de- 
scribed as follows: "Translate the input x (a number written 
in the second notational system) into the first notational sys- 
tem, they apply the algorithm A, and then translate the 
output (if A gives an output) into the second notational sys- 
tem." In a similar way, the notion of an enumerable set of 
numbers, which will be defined below, can be shown to be 
independent of our choice of notational system for writing 
numbers. 

Because of this, once we have a digital system, we shall 
not be pedantic about distinguishing between numbers and 
the digits which represent them. For example, we shall use 
the letter IN to denote both the set of natural numbers and 
the set of digital representations of natural numbers. 

A set is said to be enumerable if either it is the empty set, 
or it is the set of elements in some computable sequence (i.e., 
the set of values of some computable function which is de- 
fined on the natural numbers). We say that the function (or 
sequence) enumerates our set. Obviously, every enumerable 
set is a word set. 

Example 1. The set N 2 consisting of all pairs of natural 
numbers is enumerable. One possible choice of enumerating 
function is the function 

<p (n) = (a, 6>, where n = 2 a (26 + 1) — 1. 

Example 2. For any alphabet L, the set L°° of all words 
in the alphabet is enumerable. One possible way to construct 
an enumerating sequence is as follows. First order the ele- 
ments of L in an arbitrary way. Then list the words in L 
in the following order: with words of different lengths, the 
shorter one comes first, and with words of the same length 
we use alphabetical (also called lexicographical) order (i.e., 
when comparing two words, we find the first place, moving 
from left to right, where the letters are different, and then 
take the two words in the order in which those two different 
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letters occur in our ordering of the alphabet L). By listing 
the words in this order, we obtain the required enumerating 
sequence. 

In this second example, one might ask how we know that 
the sequence of words is enumerable, i.e., how can we ob- 
tain an algorithm which, given A, produces the kth. term 
a^ of the sequence? Here is one possible algorithm: write 
out the first k + 1 elements of the sequence (i.e., a , 
a 15 . ., a ft ), and then take the last word that was 
listed. 

Example 3. The computable function / which enumerates 
L°° and which was constructed in Example 2 gives us a one- 
to-one correspondence from !N to L°°. Hence, we have a 
well-defined inverse function /~\ which gives a one-to-one 
correspondence from L°° to N. This f" 1 is also computable, 
for example, by the following algorithm: to compute f' 1 (a), 
successively write out / (0), / (1), / (2), until you 

reach an n for which / (n) = a; this n is then f~ x (a). 

Example 4. If we have any two alphabets L x and L 2 , the 
composition of the computable function mapping INI onto 
L^° in Example 2 with the computable function mapping L* 
onto IN in Example 3 gives us a computable function which 
is a one-to-one correspondence between L~ and L^°. 

A subset S of a set A is said to be decidable relative to A 
if there exists an algorithm which determines whether or not 
an element of A belongs to S. That is, the algorithm proces- 
ses all the elements of S to a single output x (for example, x is 
the word "y es ") and processes all the elements of the comple- 
ment A \ S to a second output word y (for example, "no"; 
of course, it makes no difference which words x and y we 
choose). Obviously, a subset S is decidable relative to A 
if and only if the set A \ S is decidable relative to A. In 
part 2° of the definition of a proof (see Subsec. 1.3.2) we re- 
quired that the set of all proofs be a decidable subset of the set 
of all words in the proof alphabet. 

From the definition of decidability it follows that the do- 
main of applicability of the algorithm in the definition 
must include all of A. It makes no difference whatsoever 
what happens if the algorithm is applied to words not in A. 
For example, if we want to construct an algorithm which 
distinguishes between the poetry of Pushkin and the poetry 
of Lermontov (two famous Russian poets), in other words, 
if we want to prove that the set of poems of Pushkin is de- 
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cidable relative to the set consisting of all the poems of Push- 
kin and Lermontov, then we do not at all care what output 
is obtained (or if nothing is obtained) when we apply our al- 
gorithm to the poetry of the Soviet poet Mayakovsky or to 
the Instructions for installing a washing machine. 

One might ask the natural question: what happens if we 
use a more restrictive definition of decidability, and require 
that the algorithm in the definition be applicable only 
to elements of the set At With this narrower definition, a 
subset S is decidable relative to A if and only if the charac- 
teristic function of S relative to A (i.e., the function defined 
on A which takes the value 1 on S and on A \ S) is com- 
putable. As we shall see in Sec. 5 (Corollary 1 of the protocol 
axiom), the domain of applicability of an algorithm is al- 
ways an enumerable set. Hence, only enumerable sets could 
have decidable subsets in the sense of this new, narrower 
definition of decidability. But if our set A is enumerable, then 
both definitions of decidable subsets are equivalent. Sup- 
pose, for example, that / is a computable function which 
enumerates A, and B is an algorithm which decides the sub- 
set S relative to A in the sense of our first definition. Then 
the following algorithm will also decide S relative to A 
while at the same time having A as its domain of applica- 
bility: take an arbitrary a, successively write out / (0), / (1), 
/ (2), , and, as soon as you obtain / (n) = a apply the 

algorithm B to a. 

Remark 1. Since any computable function, enumerable 
set, or decidable subset is given by some algorithm, we can 
use purely quantitative considerations to see that there must 
exist functions which are not computable, sets which are 
not enumerable, and subsets which are not decidable. (Here 
we always mean word sets, functions having word sets as their 
domain of definition, and so on.) Namely, any algorithm can, 
if we want, ultimately be written in the English language 
(perhaps with some mathematical symbols added), i.e., ac- 
cording to Subsec. 1.1.1, it can be written as a word in some 
rather large alphabet, and in any alphabet the set of all 
words is a countable set. Of course, while this argument 
proves the existence of nonalgorithmic objects, it is of no 
use in constructing individual examples of such sets and 
functions. 

We are now ready to use these concepts from the theory of 
algorithms to study the question of whether a complete and 
consistent deductive system can exist. 
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Lemma 4. Por any Word set X, the sets and X are de* 
cidable relative to X. 

► * Let X be a word set in the alphabet L. It is enough to 
take the algorithm which gives the same output x for any in- 
put word in L°° This algorithm decides the set and 
also the set X relative to X. ■** 

Theorem I. If T is an enumerable set, then one can find a 
complete and consistent deductive system for the fundamental 
pair (L, T). 

^ We have to give the triple (P, P, 6). Recall that 
and P°° are decidable relative to P°°, by Lemma 1. If T = 
0, then we take the triple (P, 0,8), where P and 6 
are arbitrary. If T =£ 0, then T = {t (0), t (1), t (2), .}, 
where t is a computable function; we then identify n with 
the word || | of length n and set P = { | }, P = P°° f 

6 = t. ■ 

Remark 2. This proof is not really as artificial as it might 
appear at first glance. In fact', if the set of truths in some 
language is enumerable, i.e. forms an enumerable sequence, 
then, in order to see that an expression belongs to this set 
(i.e., in order to prove that the expression is true) it suffices 
to give the number of the expression in the sequence (this 
number can thus be considered to constitute the proof). 

The converse of Theorem 1 will be proveq 1 later (Theorem 
3). First we shall need to prove some auxiliary- lemmas. 

Lemma 2 (enumerability of a decidable subset). A decid- 
able subset of an enumerable set is enumerable. 
^ Suppose that S ^ A, and A is enumerated by the com- 
putable function /. If S is the empty set, then S is enumer- 
able, by definition. If S is nonempty, then there exists 
an s such that s £ S. We set 

| f(n), if /(n)GS f 

g(1l) | s, if f{n)£A\S. 

Clearly, g is a computable function which enumerates the 

set s. m 

From Lemma 2 it follows that any decidable subset of 
the set of natural numbers is enumerable. However, the con- 
verse is false: in Sec. 5 we shall construct an example of an 



♦The symbol ► marks the beginning of a proof. 
**The symbol ■ marks the end of a proof. 
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that this deductive system is incomplete for (L, T), then 
we need only find a subset V of L°° relative to which our de- 
ductive system is incomplete. We now give a construction 
which enables us to find such a subset V in many important 
cases. 

We shall say that membership in a set of natural numbers 
S is expressible by means of the fundamental pair (L, T) 
if there exists a computable function / (expressing member- 
ship in S) which is defined on the natural numbers, takes 
values in L°°, and has the properties: 

(1) if n 6 S, then / (n) £ Z\ 

(2) if n e N \ S. then / (n) £ L°°\7\ 

The set V consisting of all values of such a function / is an 
enumerable set. Hence (by Theorem 4), if we know that the 
set V f| T of true statements in V is not enumerable, we can 
conclude that there does not exist a deductive system which 
is complete and consistent relative to V And, as we shall 
now see, V f) T is a nonenumerable set if the set S is not 
enumerable. 

Lemma 6 (on the full preimage of an enumerable set). 
Let f be a computable function whose domain of definition is an 
enumerable set* Let B be an arbitrary enumerable set. Then 
the set f" 1 (B) is enumerable. 

^ If f~ l (B) is empty, then it is enumerable, by definition. 
Now suppose that c £ f' 1 (S), and the set B is enumerated 
by the computable function h. Suppose that the domain of 
definition of / is enumerated by the computable function 
g. In order* to^enumerate the set f" 1 (B) we proceed as fol- 
lows. 

We run through the set IN X IN and for each pair (m, 
k) we check whether or not / takes g (m) (the "/rath element 
listed in the domain of definition of /") to h (k) (the "fcth 
element listed in the set /?"). If it does, then we include 
g (m) in our list of the elements of / _1 (S), and if it doesn't, 
then we simply list the element c. 

More precisely, let £ and r) be defined as in the proof of 
Lemma 5. We set 

f g(l(n)), if /(?(E(n)))=A(T|(n)) f 
9 \n) = \ 

[ c, otherwise. 



* Actually, the domain of definition of any computable function 
is enumerable; however, the proof of this fact requires some further 
study of algorithms, which we shall postpone until Sec. 5 r 
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It is easy to see that cp is a computable function which enu- 
merates the set f* 1 (5). ■ 

We now return to the line of thought we left to prove Lem- 
ma 6. Note that S = f' 1 (V f] T). Thus, if S is not enumer- 
able, then neither is V f] T (since, by Lemma 6, if V fl T 
were enumerable, then its full inverse image S would also 
be enumerable). In view of Theorem 4, we have thereby 
proved: 

Theorem 5. If there is a single nonenumerable set of natural 
numbers in which membership is expressible by means of the 
fundamental pair (L, T), then there cannot exist a complete 
and consistent deductive system for (L, T). Moreover, there 
cannot exist a deductive system which is both consistent and 
complete relative to the set of values of the function which ex- 
presses membership in our nonenumerable set. 

Remark 2. The sufficient condition in Theorem 5 is also 
a necessary condition for there not to exist a deductive 
system with the indicated properties. In fact, if there is no 
complete and consistent deductive system for (L, T), then 
T is nonenumerable (by Theorem 1). Meanwhile, L°° is 
enumerable (see Example 2 in Sec. 2) and so is enumerated 
by some computable function /. Since T — f (/"* (T 7 )), it 
follows that the set f' 1 (T) is not enumerable (by Theorem 
3). But the function / expresses membership in / -1 (T) by 
means of the pair (L, T). 

4. The Language of Arithmetic 

In this section we apply the constructions of the earlier 
sections to the language of arithmetic. Intuitively speaking, 
the language of arithmetic is the language whose statements 
are given in terms of natural numbers and the addition and 
multiplication operations (using logical operations and the 
equals sign). In order to give a formal definition, we must 
construct a suitable fundamental pair. Of course, there are 
many possible ways to construct such a pair. For example, 
various different alphabets can be used. We shall choose a 
14-letter alphabet A (our "arithmetic alphabet") consisting 
of the following symbols: 

l°-2° the parentheses (and); 

3° the symbol | for forming numbers; 

4° the symbol x for forming variables; 

5°-6° the addition sign + an d multiplication sign 
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7° the equals sign = ; 

8°-14° the logical symbols ~|, A. \A -*i ^> 3. V (the 
Intuitive meanings of these symbols are as follows: "it is 
false that/' "and," "or," "if..., then," "if and only if," 
"there exists such that," "for all"). 

In order to specify a suitable set of true statements, we 
must look at some questions involving syntax. That is, we 
must identify certain classes of words in A°° and study their 
structure. 

We shall leta n denote the word a... a (repeated n times), 
where a is a letter. If n = 0, then the word a n is empty (con- 
tains no letters). By a number we mean a word of the form 
(| n ), where n^ 0, and by a variable we mean a word of the 
form (x n ), where n > 0. In our intuitive interpretation of 
the language, the word (| n ) is a way of writing the number 
n, and the word (x n ) is one of an infinite sequence of varia- 
bles (we might need an arbitrarily large number of these 
variables to write a statement in arithmetic). We now give 
the following inductive definition of a term: 

1° all numbers and all variables are terms;^ 

2° if t and u are terms, then (t -\- u) and (t-u) are terms. 

Any variable which occurs in a term will be called a 
parameter of the term. A term which has no parameters is 
called a constant. 

Example 1. The term ((111) ( | |)) is a constant. The 
terms (( )•(#)) and ((| | I ) + (xx)) are not constants: (x) is 
a parameter in the first of these terms and (xx) is a parameter 
in the second. 

!*3To any constant term we can associate a number, called 
its value, according to the following rules: 

1° the value of (| n ) is the number n, 

2° the value of a constant term of the form (t + u) is 
the sum of the values of the constant terms t and u, and the 
value of the constant term (t-u) is the product of the values 
of the constant terms t and u. 

Example 2. The constant term ((| | |) + (( | )-(| |))) has 
value 5. 

A word of the form (t = u), where t and u are terms, will 
be called an elementary formula. We then give an inductive 
definition of a formula, as follows: 

1° any elementary formula is a formula; 

2° if a is a formula, then "|a is a formula*^ 
^3° if c& and |3 are formulas, then (a f\ (5), (a V P)i (<* -* 
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->- P) and (a +* p) are formulas; 

4° if a is a formula and \ is a variable, then 3Ea and 
V£a are formulas. 

Example 3. The word 

(3 (x) V (xx) "1 ((x) = (xx)) - V (xx) ((x)=(xx))) 

is a formula. 

For ease of reading, we shall abbreviate terms and formu- 
las, writing n in place of ( | n ) and x n in place of (x n ), and 
omitting outer parentheses. For example, the formula in 
Example 3 can be written in abbreviated form as follows: 

3^ V x 2 ~~| (#i = x 2 ) *♦ Vx 2 (x x — # 2 ). 

The true statements in our language will be defined as a 
subset of the set of all formulas. But first we need to intro- 
duce the notions of a formula's parameters and the substi- 
tution of numbers in place of variables. 

To every formula we associate a certain finite set of vari- 
ables; these variables will be called the parameters of the 
formula. The set of parameters of a formula is defined in- 
ductively according to the following rules: 

1° the set of parameters of an elementary formula {t — u) 
consists of all of the parameters of the term t together with 
all of the parameters of the term u\ 

2° the formula ~]a has the same parameters as the formu- 
la a; 

3° the set of parameters of the formula (a f\ P), (a V P), 
(a -*- p) or (a *-* p) consists of all of the parameters of the 
formula a together with all of the parameters of the formu- 
la P; 

4° the set of parameters of the formula 3Ea or V£a con- 
sists of all of the parameters of the formula a except for E. 

Example 4. The only parameter of the formula in Example 
3 is x x . In fact, the formula (x t = x 2 ) has parameters x x 
and x 2 , as does the formula "~| (x 1 = x 2 ), the formula 
\fx 2 ~| (x 1 = x 2 ) has only one parameter x x , and the for- 
mula 3x^x 2 ~"| (x x = x 2 ) has no parameters. Meanwhile, 
the formula V:r 2 (x x = x 2 ) has one parameter x x . 

More intuitively, the parameters are simply the varia- 
bles which occur freely in the formula, i.e., which are not in 
the range of the quantifiers 3 and V. 

Formulas having no parameters are called closed formulas. 
The formula in Example 3 is not a closed formula. Closed 
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formulas can be interpreted as statements about the set of 
natural numbers. A closed formula is said to be "true" or 
"false" in accordance with the rules described below (which 
agree with the intuitive meaning of the symbols in the for- 
mula). The closed formulas which are given the value "true" 
will form our set of "true statements of the language of 
arithmetic." 

Example 5. The sentence "for every natural number ex- 
cept zero there exists a smaller natural number" can be 
translated into the following closed formula of arithmetic: 

Vzi ("1 (*i = 0) ->- 3^ 2 3^ 3 (10*3 

= 0) A ((*2 +* S ) = *l)))- 

Note that, because our language does not have the symbol 
<C, we had to write "x 2 is less than x" in a roundabout way, 
namely: 

3*3 (10*3 = 0) A (0*2 + 0C 3 ) = X 1 )). 

Before describing how to determine the value of a closed 
formula, we need to introduce one final technical definition. 
We now define the result of substituting the number n in place 
of the variable w in the formula a. This result is a formula 
which is denoted S™a and is defined inductively according 
to the following rules: 

1° the result of substituting n in place of w in an elementa- 
ry formula (t=u) is simply the result of replacing all oc- 
currences of the variable w by the number n; 

2° Sn la = 1*5J? a; 

3° if X is any of the symbols f\, V» ~N or +** then 

5S(aXp) = (5Jfa^p); 

4° if Q is one of the symbols V or 3 and if £ is a variable, 
then the result of substituting n in place of w in the formula 
OJ;a is the formula Q££!?a, provided that the variable w 
is different from the variable £; otherwise (if w and £ are 
the same variable) the result of the substitution is simply 
the original formula O£oc. 

Example 6, If a is the formula in Example 3, then 
5j»a is 3x^\fx 9 ^] (x x = x 2 ) «-> V^ 2 (5 = #2)1 and S?>a 
is a. Notice that if we replaced all occurrences of x x in a by 
5, then we would obtain the word 35V# 2 1 (5 — x 9 )-+- 
V.r 2 (5 = # 2 ), which is not a formula. Thus, an important 
feature of our definition is that the occurrences of w which 
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fali in the range of ^W or Vu) ate left unchanged when a 
number is substituted in place of w. 

Lemma 7. The set of parameters of the formula 5 J? a con- 
sists of all the parameters of a which are different from w. 
^ This rather obvious fact can be proved by induction on 
the number of steps in the construction of a (or by induc- 
tion on the length of the word a). ■ 

We are now ready to proceed to the determination of the 
value of a closed formula. As mentioned above, there are 
two possible values: "true" (T) and "false" (F). A closed for- 
mula having the value T will be called a "true statement," 
and a closed formula having the value F will be called a 
"false statement." We assign values to closed formulas 
using induction on the number of steps in the construction 
of the formula, as follows: 

1° the closed formula (t = u) is true if the values of the 
constant terms t and u are equal; otherwise it is false; 

2° the formula ~~|a is true if a is a false statement; other- 
wise it is false; 

3° the formula (a/\p) is true if both a and p are true 
statements, otherwise it is false; 

4° the closed formula (a \/ (3) is true if at least one of 
a or p is true, otherwise (a V p) is false; 

5° the formula (a -> (J) is false if a is a true statement and 
P is a false statement, otherwise (a ->- P) is true; 

6° the formula (a «-> P) is true if a and p are closed formu- 
las with the same truth value, otherwise (a «-► P) is false; 

7° the closed formula 3£a is true if there exists a number 
n such that Sfa is a true statement; if no such number 
exists, then 3£a is false; 

8° the closed formula V£a is true if S%a is true for all 
n\ otherwise V£oc is false. 

In connection with 7° and 8° we note that S^a is a closed 
formula, since the formula a has no parameters other than 
£ (otherwise 3£a and V£a would not be closed formu- 
las). 

Example 7. The formula in Example 5 is true. The for- 
mula in Example 3 is neither true nor false, since it is not 
a closed formula. However, the result of substitution of any 
number in place of x x in the formula in Example 3 is a true 
statement. 

Thus, it is the true closed formulas which we have chosen 
to be the true statements of arithmetic. If we let T denote 
the set of true statements, we arrive at the fundamental pair 
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^A, f ) for the language of arithmetic. The question that 
interests us is whether there exists a complete and consistent 
deductive system for this pair. We shall use the criterion 
in the last section to show that no such deductive system 
exists* 

To do this, we must show that there exists a nonenumer- 
able set of natural numbers such that membership in this 
set is expressible by means of our fundamental pair (A, 
T). For this purpose we shall introduce a certain class of 
sets such that membership in any set in this class is expres- 
sible by means of (A, T), We shall then look for a nonenu- 
merable set in this particular class. The class of sets we are 
speaking of is the class of so-called "arithmetic sets," It is 
defined as follows. 

Let a be a formula having no parameters except perhaps 
the variable x x . Then S* 1 a is a closed statement, true or 
false, for any n. We consider the set of such and only such 
numbers n for which S*»a is a true statement. We shall 
say that this set is associated with the formula a. Any set of 
numbers which is associated with some formula in A will be 
called a Godel-arithmetic set, or, for brevity, simply an 
arithmetic set. 

Arithmetic sets have several obvious properties: 

Property 1. The complement of an arithmetic set is an 
arithmetic set. Namely, if M is associated with the formula 
a, then (iN\Af) is associated with the formula ~~|a. 

Property 2. The union or intersection of two arithmetic 
sets is an arithmetic set. Namely, if M x and M 2 are associa- 
ted with 0&J and a 2 , respectively, then M x f) M 2 is associated 
with (a x /\ a 2 ), and M x U M 2 is associated with (a t V a 2 ). 

Property 3. Membership in any arithmetic set is expres- 
sible by means of (A, T). Namely, suppose that the arith- 
metic set M is associated with the formula a. We define the 
function / as follows: the value of / at n is the word S** a. 
Then / is a computable function which expresses member- 
ship in M. 

The key step in our proof of Godel's theorem is the fol- 
lowing claim: 

(*) there exists a nonenumerable arithmetic set. 

We shall postpone the proof of this claim until the next 
section. Once the claim has been proved, we can then con- 
clude, because of Property 3 and Theorem 5, that: 

there does not exist a complete and consistent deductive sys- 
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tern for the fundamental pair (A, T) of the language of arith" 
metic. 

This result is Godel's incompleteness theorem for formal 
arithmetic, it says that, given any carefully defined notion 
of proof, there exists either a provable but false statement 
in the language of arithmetic or else a true but unprovable 
statement in the language of arithmetic. 

Remark 1. Suppose that M is a nonenumerable arithmetic 
set. According to the second part of Theorem 5, if / is any 
computable function expressing membership in M and 
V is its set of values, then there does not exist a deductive 
system which is both complete and consistent relative to V, 
Thus, if we have a consistent deductive system, we must be 
able to find true but unprovable statements by looking no 
farther than the sequence / (0), / (1), / (2), . We just saw 
that we can for / take the function n »— * S^a, where M 
is associated with a. If we choose / in this way, it is natural 
to interpret the word / (n) as the statement that "n 6 M" 
Hence, speaking informally, we see that a true but unprov- 
able statement can be found (for any consistent deductive 
system!) among the statements of the form "n £ M." In the 
next section we shall see that the set M can be chosen in 
such a way that its complement £ = N\M is enumerable. 
Thus, there exists an enumerable set E such that for any con- 
sistent deductive system there is a true statement of the 
form "ra does not belong to E" which is unprovable. (Note 
that, by Theorem 1, it would be impossible to have u n 
belongs to E" in place of "n does not belong to E" here.) 

Remark 2. Several of the definitions in this section use 
induction on the number of steps in the construction of the 
terms and formulas. Here a possible difficulty arises. Sup- 
pose, for example, that a word X had the form (a /\ P) 
and simultaneously had the form (a' -> p'), where a, p t 
a', and p' are formulas. In this case the requirements of the 
sections of the inductive definition relating to formulas of 
the form (a /\ P) and to formulas of the form (a' ->■ p') 
might contradict one another. 

For this reason, when we give inductive definitions we 
must be sure that the terms and formulas can be analyzed 
in a unique way, i.e., that the different cases in the definition 
of a term and in the definition of a formula are mutually 
exclusive. When in our definitions a term or formula is ob- 
tained as a result of combining two terms or formulas, the 
terms or formulas which ?«re being combined must be 
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uniquely determined. This is the purpose for which the paren- 
theses are used in formulas. If we want a formal proof that 
terms and formulas can be analyzed in a unique way, the 
following fact will be useful: 

the number of left parentheses in a term or formula is equal 
to the number of right parentheses; and if the word X comes at 
the beginning of a term or formula and is not the whole term 
or formula, then the number of left parentheses in X is greater 
than the number of right parentheses. 

It is amusing to note that the role parentheses play in 
preventing ambiguities in our formal language is analogous 
to the role of punctuation in the natural language of every- 
day speech. For example, where one places the comma in the 
sentence "Execute we cannot show mercy!" has a crucial 
effect on the meaning; the decision about where to put the 
comma amounts to a choice between "Execute f\ we cannot 
show mercy!" and "Execute we cannot /\ show mercy!" 
By the way, it is possible to find sentences in natural lan- 
guage with ambiguities that cannot be cleared up by pun- 
ctuation. 

5. Three Axioms for the Theory 
of Algorithms 

5.0. Our goal now is to prove the claim (*) in the last 
section. However, the rather diffuse ideas about algorithms 
with which we have been satisfied in the earlier sections are 
not sufficient to prove this claim. 

The traditional method of continuing our argument would 
be to refine the idea of an algorithm, i.e., replace the some- 
what indefinite concept of algorithm which we have been 
using, which has the advantage of being completely general, 
by a more precise and restricted notion, i.e., by a "special 
type of algorithm." By the way, it should be mentioned that 
this narrower notion of an algorithm would have a claim to 
being equivalent to our original definition, in the sense that 
the class of computable functions which arises from one defi- 
nition is the same as the class of computable functions aris- 
ing from another (and, therefore, the class of enumerable 
sets is the same for each definition). This claim that the 
classes of computable functions (or enumerable sets) are 
the same does not have the status of a theorem that can be 
proved, it is rather a conjecture that can be verified in prac- 
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tice. We can then construct a precise mathematical theory 
of functions which are^computable by the "special type of 
algorithm" (here the proof of facts analogous to those in Prob- 
lems 9 and 10 for^Appendix C turns out to be technically 
the most difficult part of this theory). The unprovable belief 
that the class of functions computable by the "special type 
of algorithm" coincides with the class of all computable 
functions is important only for the purpose of justifying the 
meaningfulness of the theory. For more details on one such 
traditional approach, see Appendix C. 
^However, here we shall choose another method. Without 
committing ourselves to a special type of algorithm, we 
shall instead impose some restrictions on our original con- 
ception of an algorithm. These restrictions will be stated in 
the form of three axioms: the protocol axiom, the program 
axiom, and the arithmeticity axiom. 

5.1. The First Axiom. We consider the process of applying 
an arbitrary algorithm A to the input x to obtain the output 
y. We shall assume that all of the intermediate computa- 
tions, the entire computing process leading from x to y 
(where the word "computation" is meant in the broadest pos- 
sible sense, by no means including just numerical calcula- 
tion) can be written down in a record in such a way that this 
"protocol" contains exhaustive information about the succes- 
sive stages of the computing process. 

Example 1. When checking a computer program it is of- 
ten necessary to print out not only the final result but also 
all of the intermediate results. The resulting "computer 
protocol" is a word in the output alphabet of the computer, 
perhaps with the addition of a sign for a blank, a sign for a 
new line, etc. 

Example 2. Suppose we want to check whether children 
learning how to add a column of figures have correctly un- 
derstood the addition algorithm. We might require that in 
their written work, in addition to the final result, they also 
write down all of their steps in some agreed upon notational 
system. One might use a notational system for the computa- 
tions in which, for example, the protocol for adding 68 and 
9967 would be 

1 11 111 1111 1111 

68, 9967 68 68 68 68 68 68 10035 

9967 9967 9967 9967 9967 9967 

5 35 035 0035 10035 

3-0974 33 



Each term in the protocol is either a decimal number (in 
our example 10035), or else a pair of numbers (in our exam- 
ple 68, 9967), or else a four-storey structure such as 

11 

68 
9967 

35 

(the "basement" and "attic" may be empty). It is not hard 
to make the protocol into a word in some alphabet. Namely, 
one need only introduce some additional symbols so that, 
for example, the above four-storey structure can be written 
first as a table 



• 


* 


1 


l 


* 


* 


* 


* 


6 


8 


* 


9 


y 


6 


7 


* 


* 


* 


3 


5 



and then as a word: (**ll*/***68/*9967/***35). The entire 
protocol is written as follows: 

(68 + 9967) (*****/***68/*9967/*****)(***l*/***68/ 
*9967/****5)(**ll*/***68/*9967/***35)(*lll*/***68/ 
*9967/**035)(llll»/***68/*9967/»0035)(llllW**«68/ 
*9967/10035)(10035). 

In this notational system the protocol for adding any two 
numbers is a word in the 15-letter alphabet {0, 1, 2, 3, 4, 
5, 6, 7, 8, 9, ( ,), /, + *). 

These examples suggest the following general considera- 
tions. We shall suppose that: 

(1) for each algorithm A there is an alphabet II (the pro- 
tocol alphabet), and all protocols describing the operation of 
A for the various inputs in the algorithm's domain of appli- 
cability together form a subset P Q of the set II~; 

(2) there exist computable functions a and co such that, 
for each protocol p in P , the values a (p ) and co (p ) are, 
respectively, the input x and the output y for which the pro- 
tocol p was written (i.e., p is a protocol for the processing 
of x into y)\ 
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(3) P is decidable relative to 11 J* . 

We restate this more briefly in the form of an axiom, which 
we shall call the protocol axiom: 

for each algorithm A there exist an alphabet II , a decidable 
subset P Q of the set I1J , a computable function a, and a compu- 
table function g>, such that: 

A (x) = y if and only if there exists p in P for which 
a (p ) = * and co (p Q ) = y. 

This axiom has the following 

Corollary 1. The domain of applicability and the set of out- 
puts of an algorithm are enumerable sets. 
^ The first of these sets is a (P ), and the second is co (P ). 
Both of these sets are enumerable in view of Lemmas 2 and 
4 and Example 2 in Sec. 2. ■ 

Corollary 2. The domain of definition and the set of values 
of any computable function are enumerable sets. 
)► This follows immediately from Corollary 1. ■ 

Corollary 3. The graph of any computable function (i.e., 
the set of all pairs (x, y) for which f (x) = y) is an enumerable 
set. 

^ We apply the protocol axiom to the algorithm which 
computes / and find the corresponding set P and functions 
a and co. We then construct a computable function ip by 
setting i|) (p) = (a (p), o> (p)>. Finally, we note that the 
graph of / is precisely the set t|>(^o)» so ^ remains to apply 
Lemma 4. ■ 

Remark 1. We could have obtained Corollary 2 as a con- 
sequence of Corollary 3. Namely, we could apply Corollary 
2 of Lemma 4 and note that the domain of definition and the 
set of values of a function are, respectively, pr x M and pr a M, 
where M is the graph of the function. 

Remark 2. Enumerability of the graph of a function is not 
only a necessary condition (as we established in Corollary 3) 
but also a sufficient condition for the function to be compu- 
table. In fact, if the graph is the empty set, then the func- 
tion is nowhere defined and so is computable. If the graph 
of the function / is nonempty and is enumerated by the com- 
putable function tJj, then one can use the following algorithm 
to compute /: to compute the value / (a), go through the 
pairsij) (0), ty (1), \|) (2), ... until you obtain a pair whose first 
term is a; then / (a) is the second term in this pair. 

5.2. The Second Axiom. Functions whose arguments lie 
in X and whose values lie in Y are customarily called fun- 
ctions from X to Y. Similarly, an algorithm whose possible 
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inputs lie in X and whose outputs lie in Y will be called an 
algorithm from X to Y Here we may take X = K°° and 
Y = L°° where K and L are alphabets. An algorithm from 
K°° to L°° is a set of instructions, i.e., a text in English or 
some other language (perhaps an artificial language crea- 
ted especially for writing algorithms). Although in concrete 
situations there is usually no problem in deciding whether 
or not a given text is an algorithm, nevertheless the notion 
of a set of instructions is too vague to enable us unambigu- 
ously to distinguish between a text which is a set of instruc- 
tions and a text which is not a set of instructions. We do 
not have a single sufficiently precise way of understanding 
what a set of instructions means. The instructions could be 
written in any of many languages, and even within a single 
language the problem of interpreting the meaning of a text 
is rather complicated. 

Nevertheless, we shall assume (this will be the program 
axiom) that it is possible to identify with full certainty a set 
consisting of all sets of instructions according to a single 
uniform interpretation of what that means. This class of 
sets of instructions will be representative in a sense that will 
be made more precise below. The sets of instructions in this 
representative class will be called programs. 

We shall say that two algorithms are equivalent if they 
have the same domain of applicability and if they give the 
s ame output when they process any input in the domain of 
applicability. A set of algorithms from K 00 to L°° will be 
said to be representative (for the alphabets K and L) if any 
algorithm from K°° to L°° is equivalent to some algorithm 
in our set. When we said before that we want to be able to 
identify this set with "full certainty," we meant that we 
want it to be a decidable subset of the set of all words in 
some alphabet. When we say that we should have a "single 
uniform interpretation" of what a program is, we mean that 
there should be an algorithm U which is applicable to pairs 
(program p, input a) and which gives as output the result 
of applying the program p to the input a. (Here a denotes an 
input for p\ (p, a) is an input for U.) 

Remark 3. It is not hard to show that any of the tradi- 
tional approaches using a "special type of algorithm" can be 
reduced to the above scheme. Any such refinement of the 
notion of algorithm essentially amounts to a particular choice 
of a set P x of programs and an algorithm U which explains 
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how to apply the program to initial data; it is then claimed 
(as an unprovable stipulation) that the set P t is representa- 
tive. 

Thus, we shall assume that: 

(1) for any two alphabets K and L there is an alphabet 
F^ (the program alphabet) and a set P x of algorithms which 
are called programs and are written in the alphabet I^ 
(i.e., P x c= IT); 

(2) there exists an algorithm U from II* X K°° to L 00 (the 
algorithm for applying a program) such that U (p, a) is 
the result of applying p to a; 

(3) the set P x is representative; 

(4) the set P x is decidable relative to II*. 

Here we are by no means assuming that the alphabet TTj, 
the set P x and the algorithm U can be chosen only in one 
way. Any triple (n^ P x , U), where IT, is an alphabet, P, 
is the set of all programs written in this alphabet, and U 
is an algorithm describing how a program processes input, 
will be called a programming method from K°° to L°° Thus, 
for fixed K and L there may be various possible program- 
ming methods. 

Remark 4. Our assumptions (l)-(4) do not fully define 
what a "programming method" means. That concept in its 
entirety will remain something for us to understand on an 
intuitive level. The above assumptions merely give some 
properties of this concept (and not all the properties, as a 
deeper analysis will show), properties which we are as- 
suming are satisfied by some triple. 
FWe now proceed to state the second axiom. But first we 
need some notation. Suppose that G is an arbitrary algorithm 
from 117 X K* toL* If p £ II*, then we let G p denote the 
following algorithm from K* to L°°: for any a in K*> take 
the output from applying G p to a to be the result of applying 
G to the pair (p, a); in other words, G v (a) ~ G (p, a). 
Using this notation, we can restate our assumptions (1)- 
(4) as the following program axiom: 

for any two alphabets K and L there exist an alphabet F^ , 
a decidable subset P x of the set II*, and an algorithm U from 
II* X K°° to L°°, with the following properties: for every algo- 
rithm A from K°° to L°° there is a p in P l such that the algo- 
rithms A and U p are equivalent. 

This axiom also has some important corollaries. But first 
we give a few definitions. 
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Suppose that /, X and Y are sets, and F is a function from 
/ X X to Y. If i is an element of /, then we let F t denote 
the function from X to Y which is defined on x for which the 
pair (i, x) is in the domain of definition of F and which 
takes the value F (i, x) at such an x. Using the conditional 
equality sign, we can abbreviate this definition as follows: 
F t (x) ~ F (i, x). 

Now suppose that O is some class of functions from X 
to Y We shall say that a function F from I X X to Y is 
universal for the class <D if the following two conditions 
hold: 

1° the function F t belongs to the class <X> for every i £ /; 

2° each function in O is Ft for some i; in other words, for 
every <p 6 O there exists i 6 / such that q> (x) ~ F (i, x) 
for all x £'X. 

Corollary 1 of the program axiom. Suppose that K and L 
are two alphabets, and O i$ the family of all computable 
functions from K°° to L°°. Then there exists a computable fun- 
ction from IN X K 00 to L°° which is universal for the class (J). 
^ Condition 1° automatically holds for any computable 
function F (since if F is computable, then so are all of the 
F ( ). So we need only construct a computable function F 
from N X K 00 to L°° which satisfies condition 2°. We con- 
sider the alphabet U u the decidable subset P t of the set 
II~, and the algorithm U from 11^ X K°° to L°°, the existence 
of which is ensured by the program axiom. Since P x is a de- 
cidable subset of an enumerable set, it is enumerable, by 
Lemma 2; let / be a function which enumerates P t . Then we 
claim that the function F defined by the relation 
F (i, x)~U(f (i), x) 

has the desired property. 

To see this, let q> be any computable function from K°° 
to L°% and let A be an algorithm which computes q), i.e., 
A (x) ~ <p (x) for all x £ K°°. By the program axiom, there 
exists a p in P x such that the following conditional equality 
holds for all x 6 K°°: 

U (p, x)~A (x). 

Since p 6 Pn we have p=f (i) for some i; then for this 
i we have the chain of conditional equalities: 

F (U z)~U(f (0, x)c*U (p, x) - A (x) - q> (*), 
which shows that our function F satisfies condition 2° in 
the definition of a universal function. ■ 



As a special case of Corollary 1 we have: 
Corollary 2. There exists a computable function F from 
N X N to H which is universal for the class of all computable 
functions from N to IN. 

^ We obtain Corollary 2 from Corollary 1 if we take both K 
and L to be one of the digital alphabets for writing numbers, 
for example, the alphabet {[}. ■ 

We shall say that two functions / and g from X to Y are 
everywhere different if there is no x in X for which the con- 
ditional equality f (x) ~ g (x) holds. This means that for 
every x at least one of the functions / or g is defined at x, 
and, if both functions are defined at x, then they have differ- 
ent values there. 

Corollary 3 (from Corollary 2). There exists a computable 
function d from IN t o IN such that no computable function from 
IN to IN can be everywhere different from d, 
^ Let F be the universal function in Corollary 2. We 
take d to be the function defined by the relation: 

d (i) ~ F (f, *). 

Then d (i) ~ F t (i), so that d and F t cannot be everywhere 
different. But, since any computable function from IN to 
IN is F t for some i, this means that no computable function 
from IN to IN can be everywhere different from d. ■ 

This corollary might at first seem paradoxical, since it 
would seem that, for example, the function d x (x) ~ d (x) +1 
is everywhere different from d. The explanation for this 
apparent paradox is that d is a function which is not defined 
everywhere, so that at values of x for which d (and hence d x ) 
is undefined we have the conditional equality d x (x) ~ d (x). 
But what if, instead of d x , we considered a function D x 
which extends d x and is everywhere defined (this means that 
D x is a function which is everywhere defined and which coin- 
cides with d x wherever d x is defined)? Now this Z>j is every- 
where different from d: if d (x) is defined, then d x (x) is also 
defined and is equal to d (x) +1, in which case D x (x) = 
d (x) + 1 4^ d (x)\ while if d (x) is not defined, then we 
also have D x (x) d^. d (x), because the left side is defined and 
the right side is not. Have we found a contradiction to Corol- 
lary 3? No, there is no contradiction here, we have merely 
proved that an everywhere defined extension of the function 
d x cannot be computable. This gives us: 

Corollary 4 (from Corollary 3). There exists a computable 
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function from IN to IN which does not have a computable exten- 
sion defined on all of N. 

Suppose that q is a computable function as in Corollary 4, 
i.e., it does not have a computable extension to IN. Could 
the domain of definition of q be a decidable subset of IN? It is 
easy to see that the answer is no. Namely, if the domain of 
definition were a decidable subset of tN, then the function Q 
defined by setting 

{q(x), if x is in the domain of definition of a, 
0, if x is not in the domain of definition of q, 



would be a computable everywhere defined extension of q. 
Thus, the domain of definition of q is a nondecidable set. 
According to Corollary 2 of the protocol axiom, this set is 
enumerable. We have thereby proved 

Corollary 5 (from Corollary 4). There exists an enumerable 
nondecidable subset of the set of natural numbers. 

The fact that such a subset of !N exists is one of the most 
important facts to come out of the theory of algorithms. 

Since a subset of the natural numbers is decidable if and 
only if both it and its complement are enumerable (by Lem- 
ma 3), the preceding corollary can be restated as follows: 

Corollary 6 (from Corollary 5). There exists an enumerable 
subset of the set of natural numbers whose complement is not 
enumerable. 

5.3. The Third Axiom. If one ignores the (rather impor- 
tant) fact that computers can only work with functions de- 
fined on finite sets of natural numbers (since extremely large 
values of the argument simply will not fit in the computer), 
we may suppose that the functions which computers can 
compute are the computable numerical functions as defined 
above. It is well known that the basic operations which a 
computer can perform are addition, multiplication, and the 
logical operations. Experience working with computers leads 
one to the conviction that any computable function can be 
programmed using these operations. Consequently, one is 
led to believe that any enumerable set of natural numbers 
(since it is the set of values of a computable function) can 
be described in terms of addition, multiplication, and the 
logical operations. These considerations (for more details, 
see Appendix C) motivate the introduction of the following 
arithmeticity axiom: 
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every enumerable set of natural numbers is arithmetic. 

Finally, the claim in the last section, which it was our goal 
to prove, is now an immediate consequence of this axiom: 

there exists an arithmetic set which is not enumerable. 
Namely, the complement of the set in Corollary 6 above is 
such an arithmetic set: it is a nonenumerable set with enumer- 
able complement. Note that this set will be arithmetic be- 
cause its complement is arithmetic (the first property of 
arithmetic sets). 

We have thereby finished the proof of the incompleteness 
theorem. As we noted before, the existence of a nonenumera- 
ble arithmetic set implies the existence of a nonenumerable set 
such that membership in the set is expressible in arithmetic. 
This implies that there does not exist a deductive system 
for (A, T) which is complete and consistent relative to a 
certain enumerable subset V. Consequently, no consistent 
deductive system can be complete for (A, T). 
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A. The Syntactic and Semantic 
Formulations of the Incompleteness Theorem 

A.l. Statement of the Problem. It is natural to call the 
version of Godel's incompleteness theorem that we proved a 
"semantic" formulation, since it says something about the 
truth of statements of arithmetic. In general, the word "se- 
mantic" refers to the part of the study of a language (in our 
case the language of arithmetic) which is concerned with the 
meaning of expressions and their truth or falsity. This part 
of linguistic study is to be distinguished from syntax which 
investigates expressions in the language as combinations of 
symbols apart from their meaning. (Sometimes the word 
"syntactic" is used in a narrower sense, referring to the part 
of grammar which studies how words are combined in sen- 
tences of a natural language.) We would like to proceed to a 
syntactic formulation of the incompleteness theorem, i.e., 
our present purpose is to remove to whatever extent possible 
every reference to the truth of statements. 

A completely satisfactory execution of this task would re- 
quire us to make the notion of a proof much more concrete. 
This would take us beyond the scope of this short book. Ne- 
vertheless, in this appendix we shall take a few steps in this 
direction. 

A. 2. Syntactic Consistency and Syntactic Completeness. 
Suppose that (P, P, 8) is a deductive system over the alpha- 
bet A of the language of arithmetic. (For the remainder of 
this appendix we shall only be concerned with deductive 
systems over A.) We shall say that the deductive system is 
syntactically consistent if there does not exist a closed formu- 
la a for which both a and ~]a are provable in the deductive 
system. We shall say that the deductive system is syntacti- 
cally complete if at least one of the closed formulas a or ~]a 
is provable in the deductive system for any closed formula cc. 

These definitions can be stated more briefly if one first 
defines the notion of a closed formula which is refutable in 
the deductive system: this is a closed formula a such that 
~]ais provable in the deductive system. We can now restate 
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the above definitions as follows: a deductive system is syntac- 
tically consistent if there is no closed formula which is both 
provable and refutable in it, and the system is syntactically 
complete if every closed formula is either provable or re- 
futable. 

The lemma that follows gives the connection between these 
notions and our earlier notions of a deductive system which 
is consistent or complete for (A, T). We recall that a deduc- 
tive system is said to be consistent if all provable closed 
formulas are true, and it is said to be complete if all true 
closed formulas are provable. 

Lemma A.l. (A) A consistent deductive system is syntacti- 
cally consistent. 

(B N A complete deductive system is syntactically complete. 

(C) // a deductive system is consistent, then it is complete if 
and only if it is syntactically complete. 

^ (A) If a and ~~|a were both provable in a consistent deduc- 
tive system, then a and ~]a would both be true, and this 
contradicts the definition of truth. (B) One of the closed 
formulasaor ~~]a must be true, and hence must be provable 
if the deductive system is complete. (C) Suppose that the de- 
ductive system is consistent and syntactically complete. To 
show that it is complete, let a be a true closed formula. Then 
~~|a is false, and so ~~]a cannot be provable (because the system 
is consistent). Then, since the system is syntactically com- 
plete, a must be provable. ■ 

Because of the lemma, it is natural to propose the fol- 
lowing syntactic version of the incompleteness theorem: 

there does not exist a syntactically consistent and syntactical- 
ly complete deductive system for the language of arithmetic. 

This version has the advantage that, in the first place, it 
implies the semantic version of the incompleteness theorem 
we proved above, and, in the second place, there is nothing 
in it which refers to the truth of a statement. However, this 
statement as it stands is false. For example, a deductive sys- 
tem in which a closed formula is provable if and only if the 
symbol ~~|occurs an even number of times (such a deductive 
system exists, by Theorem 1) is syntactically consistent and 
syntactically complete. 

Upon reflection, we arrive at the conclusion that this failu- 
re is due to the absence in the above formulation of any con- 
nection with the usual meaning of the symbols of the alpha- 
bet A. In our example of a syntactically consistent and syn- 
tactically complete deductive system, both the formula 
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(2-2) = 4 and the formula (2-2) = 5 are provable. We can 
extricate ourselves from this situation if we impose the re- 
quirement on the deductive system that certain closed for- 
mulas must be provable in it. We now make this more precise. 

'Suppose that D and D are deductive systems. We shall 
say that D is an extension of D if every closed formula which 
is provable in D is also provable in D. (In this case, obvi- 
ously every closed formula which is refutable in D is also 
refutable inZ>.) We shall say that a deductive system D is 
completable if it has a completion, i.e., an extension which 
is a syntactically consistent and syntactically complete de- 
ductive system. The example above shows that the empty 
deductive system (in which no statement is provable) is 
completable. 

Using the concept of completability, we can propose ano- 
ther syntactic version of Godel's incompleteness theorem: 
there exists an uncompletable deductive system. 

But this version is meaningless since any syntactically in- 
consistent deductive system is uncompletable. Besides, we 
want the syntactic version of the incompleteness theorem to 
imply the semantic version proved above. This requirement 
will be satisfied if we choose the following version: 

there exists an uncompletable consistent deductive system. 
(This assertion implies, by the way, that there cannot exist 
a complete and consistent deductive system, since such a de- 
ductive system would be a completion of any consistent 
system.) It is this syntactic version which we shall study. 

But before proving this syntactic incompleteness theorem, 
we first explain why it is better than our original (semantic) 
version of the theorem. After all, it refers to the property 
of consistency, which is defined using the notion of truth. 
The crucial point is that it is possible to give an uncomplet- 
able consistent deductive system explicitly, and for this 
explicitly described deductive system the uncompletability 
property does not involve the concept of truth. (Of course, 
in our eyes the value of this property comes from our belief 
in the consistency of the deductive system.) 

We now proceed to the proof of the above statement. We 
shall need some new concepts from the theory of algorithms. 

A. 3. Inseparable Sets. Suppose that K is an alphabet 
and A and B are disjoint subsets of K°°. We shall say that the 
set C separates A from B if A cz C and B f] C 0. If the 
set C separates A from 5, then its complement (in K°°) 
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separates B from A, We shall say that A and B are separable 
if there exists a decidable subset C of the set K°° which 
separates A from B. (In this case the complement of C is 
a decidable subset of K°° which separates B from A.) 

Lemma A. 2. Two disjoint sets A and B are separable if and 
only if the function from K°° to H which is defined by setting 

11, if x£A, 

0, if x£B, 

undefined, if x$A\JB, 

has an everywhere defined computable extension. 
^ If g is an extension of / which is computable and is defined 
everywhere, then the decidable set {x | g (x) = 1} separates 
A from B. Conversely, if C is a decidable set which separa- 
tes A from B, then the computable function g which equals 1 
on elements of C and elsewhere is an extension of /. ■ 

Lemma A. 3. There exist inseparable enumerable subsets 
of IN. 

^ According to the preceding lemma, it suffices to show 
that there exists a computable function h from N to tNl 
which takes on only the two values and 1 and which does 
not have an everywhere defined computable extension. In 
that case the sets {x j h (x) = 1} and { x | h (x) = 0} will 
be enumerable (by Lemma 6 and Corollary 1 of the protocol 
axiom) and inseparable. In order to construct a function h 
with the desired properties, we refer to the proof of Corollary 
4 of the program axiom in Sec. 5 and consider the function d 
which has the property that no computable function can be 
everywhere different from it. We define the function h as 
follows: 



1, if d(x)=0 9 

h (x) = ^ 0, if d (x) is defined and nonzero, 

undefined, if d (x) is undefined. 
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Any everywhere defined extension of h would be everywhere 
different from d\ hence it could not be computable. ■ 

We now state a criterion for a deductive system to be 
uncompletable which uses the notion of inseparability. 
Theorem A.l. // the set of provable closed formulas and the 
set of refutable closed formulas in a given deductive system are 
inseparable, then this deductive system is uncompletable. 
^ If the deductive system had a completion, then the set 
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of provable closed formulas and the set of refutable closed 
formulas in the completion would be disjoint enumerable 
sets which together exhaust the set of all closed formulas. 
By Lemma 3, each of these two sets — in particular, the set 
S of provable closed formulas— is a decidable subset of the 
set of all closed formulas, and hence a decidable subset of 
the set A°°. The set S separates the set of closed formulas 
provable in our original deductive system from the set of 
closed formulas which are refutable in that system. But this 
contradicts the hypothesis of the theorem. ■ 

A. 4. Construction of an Uncompletable Deductive Sys- 
tem. We shall use Theorem A.l to construct an uncompletable 
deductive system. Let P and Q be inseparable enumerable 
subsets of H (such sets exist by Lemma A. 3). P is an arith- 
metic set, by the arithmeticity axiom (see Sec. 5); let P be 
associated with the formula a. Let [n 6 P] denote the 
formula S* l a (where n is a number). The formula [n £ P] 
is true if and only if n £ P. For each n in P we consider the 
(true) formula [n £ P]\ for each n in Q we consider the (also 
true) formula ~~] [n £ P]. These formulas form an enumera- 
ble set. According to Theorem 1, there exists a deductive 
system in which these formulas and only these formulas are 
provable. This deductive system is consistent. We now show 
that it is uncompletable. According to Theorem A.l, in order 
to do this it suffices to prove that the set of provable for- 
mulas in the deductive system and the set of refutable for- 
mulas are inseparable. We now show this. If n £ P, then the 
formula [n £ P\ is provable; if n £ <?, then the formula 
[n £ P] is refutable. Thus, if S were a decidable set which 
separated the provable formulas from the refutable ones, 
then the decidable set {n | [n £ P] £ S) would separate P 
from Q, and this is impossible. We have thus constructed an 
uncompletable deductive system. 

B. Arithmetic Sets and Tarski's Theorem 

on the Nonarithmeticity of the Set 

of True Formulas of the Language 

of Arithmetic 

As explained in Sec. 4, the closed formulas of the lan- 
guage of arithmetic are statements about properties ot the 
set of natural numbers and the operations of addition and 
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multiplication. These statements can be either true or false. 
However, the question "True or false?" has no meaning for 
formulas with parameters. If we replace the parameters in 
a formula by numbers, then we obtain a closed formula 
whose truth value in general depends upon which numbers 
we substituted in place of the variables. Thus, formulas 
with parameters can be interpreted as properties of natural 
numbers. 

Example 1. The result of substituting n in place of x x in 
the formula 3x 2 ((x 2 + x 2 ) = x t ) is a true statement if and 
only if n is even. Thus, we could say that this formula 
expresses the property ii x 1 is even." It is also common to say 
(somewhat imprecisely) that this formula is true for even 
values of x x and false for odd values of x x . 

Example 2. The formula 3x 3 ((x x + x 3 ) = x 2 ) expresses 
the property "x x ^ x 2 " 

Example 3. The formula 3x 2 ((^i m x 2 ) = x 3 ) expresses the 
property "x x divides x 3 ." 

Example 4. Let [x x divides x 3 ] denote the formula in 
Example 3. Then the formula 

Vx x (lx x divides x 3 ]->- ((x x = 1) V (x x = x 3 ))) 

expresses the property u x 3 is prime or equal to 1." 

Example 5. Let lx x is even] denote the formula in Exam- 
ple 1. Then the formula 

V^! (\x x divides x 3 ]->- ([x x is even] V (x x = 1))) 

expresses the property "every divisor of x 3 is either even or 
equal to 1," i.e., "x 3 is a power of 2." 

Properties which are expressible by the formulas of the 
language of arithmetic are called arithmetic properties. 
The subset of N* consisting of /c-tuples of natural numbers 
having a certain arithmetic property is called an arithmetic 
subset of H\l\ The definition of an arithmetic subset of IN 
that was given in Sec. 4 is a special case (k = 1) of this 
definition. 

We now make these definitions precise. Suppose that a 
is a formula in the language of arithmetic, w ly ., w p are 
variables, and c ly ., c p are numbers. By the result of sub- 
stituting c x> ., c p in place of w lf ., w p in a we mean the 
formula 
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which is obtained from a by successively^substituting c x in 
place of w x , c 2 in place of w 2 , . ., c p in place of w p . (It is 
easy to see that these substitutions can be performed in any 
order; for example, the result would have been the same if 

we had defined iS cl V.7c p a as S^ .S c p a.) 

Let a be a formula of arithmetic whose parameters are 
a subset of x x , ., x k . We consider the subset of H k consist- 
ing of A;-tuples {c x , ., c h ) for which the closed formula 

Sci...c£a ^ s true * We shall say that this set is associated 
with the formula a. A set which is associated with a formula 
of arithmetic will be called an arithmetic set. When k = 1, 
this gives us the earlier definition (in Sec. 4) of an arithmet- 
ic subset of the set of natural numbers. . We shall identify 
properties with the sets of objects having the property, and 
so shall speak of the arithmeticity of properties of natural 
numbers. 

Example 6. The sets {{x x , x 2 ) | x x = x 2 }, {(%ii x 2J x 3 ) \ x x -\- 
x 2 = x 3 } and {{x Xl x 2 , x 3 ) | x x -x 2 = x 3 } are all arithmetic, 
since they are associated with the formulas x x = x 2 > (x x -{- 
x 2 ) = # 3 , and (x x -x 2 ) = x 3y respectively. 

Example 7. The set {(x x , x 2 ) | x x ^. x 2 } is associated with 
the formula in Example 2, and so is an arithmetic set. 

Example 8. The set {(x Xi x 2 ) \ x x divides # 2 } is arithmet- 
ic. To construct a formula with which it is associated, we 
must slightly modify the formula in Example 3 by inter- 
changing x 2 and x 3 . 

Example 9. The set of prime numbers and the set of powers 
of 2 are arithmetic subsets of the set of natural numbers 
(see Examples 4 and 5). 

The properties of arithmetic subsets of LN that were given 
in Sec. 4 hold more generally for arithmetic subsets of u\i A . 
In particular, we have: 

Lemma B.l. (a) The complement (in u\| ;t ) of an arithmetic 
subset of 1N A is arithmetic; 

(b) the union or intersection of two arithmetic subsets of H H 
is arithmetic. 

The next lemma says that arithmeticity is preserved if one 
permutes the coordinates. 

Lemma B.2. Let a be a permutation of the set (1, ., k) 
(i.e., a one-to-one correspondence from the set to itself) > and let 
M be an arithmetic subset of n h . Then the set 

M a = {(x v . . ., x h ) | (z a(1) , . . ., x oW ) £ M\ 
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is arithmetic* 

^ If the set M is associated with the formula a, then the set 
M° is associated with the formula a a which is obtained from 
a by replacing each variable in the list x x , ., x h by the 
corresponding variable in the list x ( X ) , . ., x ( h) . ■ 

The next two lemmas give a connection between the clas- 
ses of arithmetic subsets of U h for different k. 

Lemma B.3. // M is an arithmetic subset of H h , then 
M X W 1 is an arithmetic subset of H h+h . 
^ In fact, M X H h is associated with the same formula 
as M. ■ 

Lemma B.4. // Ma H k+h is an arithmetic subset, then its 
projection onto the first k coordinates, i.e., the set 

M' = {{x x , x h ) | 3x ft+1 . 3x h+h (<*!, 

x h+h )eM)}, 

is an arithmetic subset of IN*. 

^ If M is associated with the formula a, then M' is associ- 
ated with the formula Ba^+i. . . 3x k + h a. 

Combining Lemmas B.2 and B.4, we can conclude that the 
projection of an arithmetic set onto any set of axes is arith- 
metic. ■ 

Suppose that Ma IN 2 is an arithmetic set. For each n £ IN 
we consider the "cross-section" M n , which is the set of x 
for which (n, x) £ M. Since it is a projection of the set 
({n} X IN) n M, it is arithmetic. We shall say that IcN 2 
is a universal arithmetic set if any arithmetic subset of N 
is a cross-section of M . It turns out that there is no such set. 

Theorem B.l. A universal arithmetic set does not exist. 
That is, for any arithmetic set Ma il\l 2 there exists an arithmet- 
ic set Qa IN which is different from every cross-section of M. 
^ The set Q — {x | {x, x) §M) is arithmetic, since it is 
a projection of the set (u\l 2 \M) (] {(x, y) \ x = y}. But it 
cannot be a cross-section of M, since if Q were the same as M n , 
then, by the definition of M n , we would have n £Q <=> 
(n, n) £ M ; but n ^,Q<=^(n, n)($M, by the definition 
of Q. (In other words, Q and M n cannot coincide because 
they "look different" at n.) ■ 

A function / from iN'* to iN u is said to be arithmetic if 
its graph is an arithmetic subset of U k+fl . 

Lemma B.5. The image and preimage of an arithmetic 
set under an arithmetic function are arithmetic sets. 
► As a first case let us consider the image of an arithmetic 
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Set A a N under ah arithmetic function / from N to iNl. 
This image is a projection of the set (graph of f) (] (A X IN), 
and so is an arithmetic set. In other words, if we let [/ (x x ) = 
x 2 ] denote the formula with which the graph of / is asso- 
ciated and let [x x £ A] denote the formula with which the 
set A is associated, then the formula 

affi(t/(*i) = x 2 \ A UiCiH) 

is true for values of x 2 belonging to the image of A and for 
no other values. So in order to find a formula with which the 
image of A is associated, it suffices to permute the variables 
(interchange x x and x 2 ). 

The preimage of an arithmetic set A under the function / 
is associated with the formula 

3*a([/ (*i) = x ^ A 1*2 6 41). 

where [x 2 £ A] denotes the formula obtained from [x x £ A] 
by interchanging the variables x 1 and x 2 . The general case of 
a function from [M A to H h is proved in the same way. ■ 

We are interested in proving Tarski's theorem, which 
says: 

the set of true formulas of arithmetic is nonar Mimetic. 
In order to make sense of this assertion, we have to explain 
what we mean by arithmeticity of a set of formulas, which 
is a subset of A°° This can be done as follows: choose a one- 
to-one correspondence between A°° and ift (a numbei mgof A°°), 
so that each word X in A°° is associated to some natural 
number (called the number of X in this numbering). We say 
that a set M c= A°° is arithmetic (with respect to the chosen 
numbering) if the set of numbers of the words in M is an 
arithmetic subset of iN. 

Of course, this definition depends on the choice of num- 
bering of the words in the alphabet A. We say that two num- 
berings are arithmetically equivalent if the function which 
goes from the number of a word in one numbering to its num- 
ber in the other numbering is an arithmetic function. 

Lemma B.6. // a set M a A°° is arithmetic relative to a giv- 
en numbering n x , then it is arithmetic relative to any num- 
bering ji 2 which is arithmetically equivalent to ji 1# 
^ By assumption, ji x (M) (which consists of all ^-numbers 
of words in M ) is an arithmetic set. Since the set ji 2 (M) is 
the image of ji x (M) under the function which goes from 
ji 2 -numbers to ^-numbers, and since this function is 
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arithmetic by assumption, it follows that jt 2 (M) is also 
arithmetic. ■ 

Finally, we define an arithmetic set of words in the alpha- 
bet A to be a set which is arithmetic relative to some com- 
putable numbering of A°°. (A numbering is said to be com- 
putable if the function which associates a number to every 
word is a computable function. In this case the inverse, 
which associates the word with number n to a natural num- 
ber n t is also a computable function. The existence of com- 
putable numberings of A°° was established in Example 3 of 
Sec. 2.) 

We now show that this definition can equally well be given 
in the form: an arithmetic set of words is a set which is 
arithmetic relative to any computable numbering of A°°. 
If n x and ji 2 are two computable numberings, then the func- 
tion which goes from the ji^-number of a word to its jx 2 - 
number is a computable function from INI to M. (It can be 
computed by the following algorithm: given an argument x, 
run through all words in the alphabet A, compute their 
n-c numbers, and wait for a word to appear whose ^-num- 
ber is x\ once this word has been found, compute its n 2 - 
number.) Thus, our claim follows once we prove the fol- 
lowing lemma. 

Lemma B.7. Every computable junction from \H P to U q is 
arithmetic. 

^ The graph of a computable function from \A V to M g is 
an enumerable subset of M p+g by Corollary 3 of the protocol 
axiom. Hence the lemma follows from the following streng- 
thened form of the arithmeticity axiom: 

every enumerable subset of IN A is arithmetic. 
(In Sec. 5 we called the special case of this for k = 1 the 
arithmeticity axiom.) ■ 

Theorem B.2. The set T of true formulas of arithmetic's 
not an arithmetic set. 

^ We shall show that if T were arithmetic, then a universal 
arithmetic set would exist, in contradiction to Theorem B.l. 
Following Godel, we shall call a formula a class formula if 
it has no parameters other than x x . The set of all class for- 
mulas is a decidable subset of the enumerable set A°°, and 
so is enumerable. We fix an enumeration a , a x , a 2 , of 

the set of class formulas. We consider the set 
M = {(n, m) \ the result of substituting 

m in place of x x in a n is a true statement}. 
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Since the nth. cross-section of this set is obviously asso- 
ciated with the formula a n , it follows that the cross-sec- 
tions of this set exhaust all arithmetic subsets of IN. It remains 
to show that if T were arithmetic, then M would also be 
arithmetic. 

Recalling the definition of arithmeticity of a set of words, 
we fix an arbitrary computable numbering of A°° Let T' be 
the set of numbers of words in T under this numbering. 
Let S be the function which associates to the pair (m, n) 
the number of the word which is the result of substituting m 
in place of x 1 in a n . S is a computable function, and so, 
by Lemma B.7, it is an arithmetic function. The set M is 
the preimage of T' under the function S. Thus, the arithme- 
ticity of T' implies that M is arithmetic, by Lemma B.5. 
Theorem B.2 is proved. ■ 

A close examination of the proof of Theorem B.2 reveals 
that it is connected with the "liar paradox." We briefly ex- 
plain this connection. 

The liar paradox is the following. Someone announces: 
"What I am saying now is a lie." Is this statement true or 
false? Either answer to this question leads to a contradic- 
tion. If we say the statement is true, then, because of the 
very meaning of the statement, it must be false; and converse- 
ly. We nowgive a presentation of our proof of Theorem B.2 
in a form which resembles this paradox. 
^ Suppose that the set of numbers of true statements of 
arithmetic is an arithmetic set. Let [word with number x 3 is 
true] denote the formula which has one parameter x 3 and 
which expresses the property "the word with number x 3 belongs 
to 7 1 , " i.e., the property"^ £ T 7 '." The function S is arith- 
metic; we let 

[x 3 is the number of the result of substituting x 2 

in the a^th class formula] 

denote the formula with which the graph of *S is associated. 

The formula 

3# 3 ([word with number x 3 is true] 

/\ [x 3 is the number of the result of substituting x 2 

in the a^th class formula]) 
has parameters x x and x 2 . The set M is associated with this 
formula, which we shall henceforth denote by 

[result of substituting x 2 in the a^th class formula is true]. 
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The rest of the argument follows the proof of the theorem 
that there is no universal arithmetic set. We consider the 
formula 

"~|3^ 2 ((^i = x z) A I result of substituting x 2 

in the a^th class formula is true]), 

which we shall denote by 

[result of substituting x 1 in the a^th class formula is false]. 

This last formula has one parameter x x , and corresponds to 
the set Q in the proof of Theorem B.l, in the sense that the 
result of substituting n in place of x x in this formula is true 
if and only if the result of substituting n in the nth class 
formula is false. This formula is a class formula, and so has 
some number (which we denote n) in the enumeration of the 
class formulas. We now substitute n in place of x ± in our 
formula, and denote the result of this substitution by 

I result of substituting n 

in the nth. class formula is false]. 

This is a closed formula which is true if and only if the 
result of substituting the number n in the rath class formula 
is false. But this closed formula is nothing other than that 
very result of substituting n in the nth class formula. Thus, 
the closed formula 

[result of substituting n 

in the rath class formula is false] 

is true if and only if it is false. We would have been com- 
pletely justified in denoting the statement: [I am lying]. We 
have obtained a contradiction, which shows that the set of 
true formulas of arithmetic is not an arithmetic set. ■ 

C. The Language of Address Programs, 
the Extended Language of Arithmetic, 
and the Arithmeticity Axiom 

In this appendix we shall attempt to justify the arithme- 
ticity axiom. Our plan of argument is as follows. First we 
shall describe a certain concrete class of algorithms— the 
class of address programs. It is natural to use the term 
"address-computable" to refer to functions which are com- 
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putable using algorithms from this class. Next we shall prove 
that the range of values of any address-computable function 
is an arithmetic set. This will justify the arithmeticity axi- 
om—provided that one believes that every computable 
function is address-computable. 

As an aid in carrying out this program we shall introduce 
an extended language of arithmetic, which has some addi- 
tional means of expression not in the language of arithmetic 
that was described in Sec. 4. We shall show that the set of 
values of any address-computable function can be described 
by a formula in this extended language of arithmetic. Then 
we shall show that the use of this extended language was 
not actually essential, i.e., for every formula in the extend- 
ed language we can find a substitute in the usual language 
of arithmetic. This will jmply that the set of values of any 
address-computable function can be described by a formula 
in the language of arithmetic, i.e., it is an arithmetic set. 

We begin with the following simple observation: in order 
to justify the arithmeticity axiom (and even the streng- 
thened version in Appendix B), it suffices for us to be able to 
prove that 

the graph of any computable function from N to U is an 
arithmetic subset of IN 2 . 

(The definition of an arithmetic subset of N 2 was given in 
Appendix B.) To see this, suppose that this assertion is true. 
Then every enumerable subset of IN is arithmetic, since it is 
a projection of the graph of the computable function which 
enumerates it (see Lemma B.4). We now prove from this 
that the strengthened version of the arithmeticity axiom 
holds. 

Let Mcz U k be an enumerable set, and let g be the func- 
tion from H to \H h which enumerates it. The value of g 
at the number n is a /c-tuple g (n) = {g x (n), ., g h (n)). 
The functions g x , ., g h are computable functions from M 
to W, and so, by our assumption, their graphs are arithmet- 
ic. We let [g t (xj) = x 2 ] denote the formulas with which these 
graphs are associated. The graph of g is an arithmetic 
subset of M h+l because it is associated with the formula 

tei (*i) = * 2 ] 

A (te 2 (*i) = s 8 ] A (• • Ate* to) = Sfe+il). .). 

where we have let [g t (x x ) = x i + 1 ] denote the formula ob- 
tained from [g t (x x ) — x 2 \ by the permutation of variables 
which interchanges x 2 and ^+ t . The set M is the projection 
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of the graph of g onto the x 2 , o: ft + 1 -axes, and so is an 

arithmetic set. 

Thus, our goal is now to prove that the graph of any com- 
putable function from M to N is an arithmetic subset of N 2 . 
This is not, however, a trivial task, as the reader will undoubt- 
edly agree after trying to prove directly, for example, the 
arithmeticity of the exponential function to base 2, i.e., the 
arithmeticity of the set {(x, y)\y = 2 X ). 

C.l. The Language of Address Programs. We now describe 
a class of algorithms of a special type, which we shall call 
address programs. These programs are reminiscent of real 
"machine language" programs used with actual computers. 

An address program is a sequence of commands listed in 
order. Each command has one of the following forms: 

1° R (a) ■+- b (assigning a value); 

2° R (a) +- R (b) (moving a value); 

3° R (a)+-R (b) + R (c) (addition); 

4° R (a) +-R (b)-R (c) (multiplication); 

5° GO TO n (unconditional transfer); 

6° IF R (a) = R (b) GO TO m ELSE GO TO n (condi- 
tional transfer); 

7° STOP. 
Here a, b and c are arbitrary natural numbers ("register 
numbers"), and m and n are natural numbers which denote 
the order of a command in the program. The last command 
in any program must be a command of the form 7° We have 
given names for the types of commands in parentheses. 

Here is a simple example of an address program: 

Example 1 . 

1 R (1)^-1 

2i?(2)4-l 

3 R (3) «- 1 

4 R (2)+-R (2)>R (1) 

5 R(l)+-R(i) +i?(3) 

6 IF R (1) = R (0) GO TO 7 ELSE GO TO 4 

7 R (0) «- R (2) 

8 STOP. 

Address programs can be executed on "address machines" 
(which exist only in theory). 

An address machine is^assumed to have infinitely many 
locations for storing "natural numbers~(its memory). These 
locations are called registers. At a given instant exactly 
one number is stored in each register. The registers are num- 
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bered 0, 1, 2, and are denoted R (0), R (1), R (2), 

respectively. 

An address machine executes the program in the order that 
the commands are numbered; this order is violated only 
when a conditional or unconditional transfer command is exe- 
cuted. Before giving more precise definitions, we shall 
describe how an address machine goes through the program 
in Example 1. Suppose that we start with the number 100 in 
the register R (0) and zero in each of the other registers. 
The first three commands assign the initial value 1 to the 
registers R (i)-R (3). The number in the register R (3) does 
not change during the rest of the execution of the program, 
the number in R (1) increases by 1 from time to time (at 
command 5; recall that R (3) always stores the number 1), 
and the number in R (2) is multiplied by the value in 7? (1) 
from time to time. The execution stops when the number in 
R (1) becomes equal to the number in R (0). The following 
table shows how the numbers in the registers change as the 
program is executed: 



command 
number 



fl(0) 



K(D 



R(2) 



K(3) 



ft (4) 



1 

2 
3 

4 
5 
6 
4 
5 
6 
4 
5 
6 
4 

6 

4 
5 
6 

7 
8 



100 








100 


1 





100 
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As a result of the execution of this program the number 
99!(l-2.. -99) is put into the register i?(0). If 200 rati) er 
than 100 were in R (0) at the beginning, then at the end we 
would have to fit the number 199! (1-2. . .-199) into our 
register R (0). And if all registers stored zero at the beginning, 
then the execution of the program would never stop. 

We now give some precise definitions. The state of an 
address machine is an infinite sequence of natural numbers 
s = (s , s 11 .) almost all of which (i.e., all but finitely 
many) are zero. If s = 0, then we call the state a final 
state (or stop); iis ^ 1, then we call it a working state, and 
we call s the command number being executed. We call 
s i+1 the number in the ith register. 

Let p be an address program, and let s = (s , s x , . .) 
be a working state. We say that p is applicable to the state s 
if s is the number of a command of p (there might not be 
a command with number s if s is too large). In this case 
we define a state s' which is called the immediate result of 
applying the program p to the state s. This state s' = (s' Q , 
s[, . . .) is determined as follows: 

1° if command number s has the form R (a) <- b, then 
5 i — 5 o + 1» s \+\ — s i+i for i =£ a, and s' a+ \ — b (all 
registers except for the ath remain unchanged, the number 
in the ath register is replaced by fc, and the machine moves 
on to the next command); 

2° if command number s has the form R (a) <- R (&), 
then s' = s + 1, sj +1 = s i+1 for i =^= a, and Sa+i = s b+1 
(all registers except for the ath remain unchanged, the num- 
ber in the ath register is replaced by the number in the bih 
register, and the machine moves on to the next command); 

3° if command number s has the form R (a) *- R (b) + 
R (c), then s' = s + 1, s\ +i = s Ul for i =#= 0> and 
5 aH-i = s&+i + s c +! (all registers except for the ath 
remain unchanged, the number in the ath register is replaced 
by the sum of the numbers in the bih and cih registers, 
and the machine moves on to the next command); 

4° if command number s has the form R (a) <- R (b)-R (c), 
then s' = s + 1, $i+i = s i+1 for i =# a, and s^-m = 
s b+l -s c+1 (same as 3° except with multiplication instead of 
addition); 

5° if command number s has the form GO TO n, then s' = 
72, r and s'i+i = s i+1 for all i (all registers remain unchanged, 
and the machine moves on to the rath command); 

6° if command number s has the form IF R (a) = R (6) 
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GO TO m ELSE GO TO n, then s' i+1 - s i+1 for all i, and s' 
is equal to rci if s a+1 = s b+1 and equal to n if s a+1 =7^= s b+1 
(all registers remain unchanged, and the machine moves 
either to the with or rath command, depending on whether 
or not the numbers in the ath and 6th registers are equal); 
7° if command number s has the form STOP, then s- +1 = 
5,- +1 for all i and s' = (the machine goes to the final state). 
This completes the definition of the immediate result of 
applying a program to a state. We note that if p is applica- 
ble to the state s, then the immediate result of applying p 
to s is either a final state or else a state to which p is again 
applicable. We always assume that the numbers m and n in 
transfer commands are numbers of commands in the pro- 
gram, and that the last command is STOP. 

By a protocol for an address program p we mean a sequence 
of states 5°, s 1 , . ., s k such that each state after s° is the 
immediate result of applying p to the preceding state, 
and the last state is a final state. We call s° the initial state 
of the protocol. There exists at most one protocol for a given 
address program and a given initial state; there might be no 
protocol, if either p is not applicable to 5° or there is no final 
state in the sequence of states obtained by successively 
applying p. 

Suppose that p is an address program and k is a natural 
number. We consider the function / from tN ft to N which is 
defined as follows: the value of / at the Zc-tuple (a 1? ., a k ) 
is b if there exists a protocol for p whose initial state is 
(1, a Xl a 2 , ., a k , 0, 0, .) and if b is the number in the 
0th register at the final state of this protocol. In other words, 
the value of / at (a x , ., a k ) is the number in 7? (0) after the 
execution of the program if a l7 . ., a h were in R (0), ., 
., R (k — 1) and zeros were in all the other registers at 
the beginning of the execution of the program, and the 
program begins with command number 1. We then call / 
a function which is k-computable by the program p (or sim- 
ply computable by p if the value of A: is clear from the context). 
Example 2. Let p be the address program in Example 1. 
The following function f t is 1-computable by this program: 
f x (0) is not defined, f t (i) = (i — 1)! for i^ 1. The function 
/ 2 which is 2-computable by p is as follows: / 2 (/, 7) is not 
defined if 1 = 0, f 2 (*, /) = (*' — 1)! if i> 1. 

Functions which are /^-computable by address programs 
will be called address-computable functions of k variables. It 
is obvious that all address-computable functions are com- 
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putable. And all known computable functions turn out to be 
address-computable. Thus, it is reasonable to conjecture 
that the class of computable functions from U h to N and 
the class of address-computable functions are the same. 
Assuming this conjecture to be true, we shall now proceed 
to prove the arithmeticity axiom on that basis. 

C.2. The Extended Language o! Arithmetic. As an aid in 
proving arithmeticity of address-computable functions we 
shall develop an extended language of arithmetic. In order 
to define this language, we have to introduce some modi- 
fications to the definition of the language of arithmetic in 
Sec. 4. 

We add two new symbols to the alphabet of arithmetic: v 
(for forming one-place functional variables) and w (for form- 
ing two-place functional variables). A word of the form 
(v n ) will be called a one-place functional variable, and a word 
of the form (w n ) will be called a two-place functional variable. 
(Here n^ 1.) We shall use the notation v n and w n to abbre- 
viate these one- and two-place functional variables. The 
interpretation we have in mind for one- and two-place func- 
tional variables is everywhere defined functions of one and 
two variables, where the variables and the functions take 
on natural number values. We shall call our old variables 
x n numerical variables. 

We define a term in the extended language of arithmetic 
as follows: 

1° a numerical variable is a term; 

2° if t and u are terms, then (t + u) and (t-u) are terms; 

3° if p is a one-place functional variable and t is a term, 
then p (t) is a term; 

4° if r is a two-place functional variable and t and u are 
terms, then r (t, u) is a term. 

Example 1. The words (v, k (x x ) + x 2 ), v A (v 5 (w 2 (x x , x 2 ))), 
and w 2 (w 2 (x^ # 4 ), x 7 ) are terms in the extended language 
of arithmetic. 

As before, an elementary formula is two terms joined by 
an equals sign (except that now the terms are in the extended 
language). The formulas of the extended language of arith- 
metic are defined in the same way as in Sec. 4, except that 
in 4° the variable £ can be either a numerical variable, a one- 
place functional variable, or a two-place functional variable. 

Example 2. The words V^ (v ± (x x ) = v x (x 2 )), Vx x V 
x 2 (v 1 (xj = v l (x 2 )), and Vwjlxjix 2 (w x (x x , x 1 )=w 1 (x 2y xj) 
are formulas. 
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The parameters of terms and formulas are denned as in 
Sec. 4; parameters can include functional as well as nu- 
merical variables. 

Example 3. The parameters in Example 1 are y 4 , x x and 
x 2 for the first term; i> 4 , v 5 , w 2 , x Y and x 2 for the second term; 
and w 2 , #j, x 4 and x 7 for the third term. The parameters in 
Example 2 are x x and x 2 for the first formula; v x for the second 
formula; and the third formula has no parameters. 

Formulas which have no parameters are called closed for- 
mulas of the extended language of arithmetic. 

We must now determine which are the true closed formu- 
las of the extended language of arithmetic. We will have two 
different definitions of truth for the formulas of the extend- 
ed language of arithmetic, i.e., two interpretations of this 
extended language. In one definition the functional variables 
can be any (everywhere defined) functions in one or two 
variables with the variables taking on natural number 
values, and in the other definition they can only be finite 
functions, i.e., functions which are nonzero only at finitely 
many values of the argument. In order to avoid having to 
give essentially the same definition twice, we shall refer 
to the class of admissible functions, by which we shall mean 
either the class of all functions or the class of all finite 
functions. 

The definition of truth will be similar to that in Sec. 4. 
The new ingredient will be the case of a formula which 
begins with a quantifier with respect to a functional varia- 
ble. Here we encounter the following problem: we would like 
to say, for example, that the formula Vra is true if, for 
all admissible values of v y the formula obtained from a 
by substituting the values in place of v is true. However, 
our language is not equipped with anything that can be 
substituted in place of a functional variable. This dilem- 
ma can be resolved as follows: we must introduce functional 
constants into our language, one for each admissible func- 
tion. 

We now give the precise definitions. We choose a set of 
symbols which is in one-to-one correspondence with the set 
of admissible functions. We shall call the symbols in this 
set functional constants which describe the corresponding 
functions. Each one is either a one-place or a two-place 
functional constant, depending on the number of variables 
in the corresponding function. We shall substitute function- 
al constants in place of functional variables having the same 
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number of arguments. By an evaluated term (or evaluated 
formula) we shall mean the result of substituting any func- 
tional constants in place of all of the functional parameters 
and any numbers in place of all of the numerical parameters 
in some term (or formula) of the extended language of 
arithmetic. This substitution is carried out in the same 
way as in Sec. 4, i.e., only occurrences of a variable which are 
outside of the range of action of quantifiers are replaced. 
A special case of an evaluated term is a constant term, 
i.e., one with no parameters (such a term is then also a term 
of the usual language of arithmetic). A special case of an 
evaluated formula is a closed formula of the extended lan- 
guage of arithmetic. 

We can now define the value of an evaluated term or 
formula in a way which is completely analogous to the cor- 
responding definitions for constant terms and closed formu- 
las in the usual language of arithmetic. The values of evalu- 
ated terms are defined as follows: 

1° the value of (| ?t ) is the number n; 
2° the value of an evaluated term of the form (i + u) 
is the sum of the values of the evaluated terms t and u, 
and the value of an evaluated term of the form (t-u) is the 
product of the values of the evaluated terms t and u\ 

3° the value of an evaluated term of the form y (£), where y 
is a one-place functional constant and t is an evaluated term, 
is the value of the function described by y at the number 
which is the value of the evaluated terms t\ 

4° the value of an evaluated term of the form 6 (t> u), 
where 6 is a two-place functional constant and t and u are 
evaluated terms, is the value of the function from IN 2 to Hsl 
described by 6 at the pair (value of t, value of u). 

To define the value of an evaluated formula, we can now 
use the definition in Sec. 4 of the value of a closed formula 
in the language of arithmetic, replacing the words "closed 
formula" by "evaluated formula" and "constant term" by 
"evaluated term," specifying in 7° and 8° that \ is a numerical 
variable, and inserting the following two paragraphs: 

9° the evaluated formula 3£a, where £ is a functional 
variable, is true if there exists a functional constant y with 
the same number of arguments as £ and having the property 
that the evaluated formula S\a is true; if no such functional 
constant exists, then the evaluated formula 3|a is false; 
10° the evaluated formula V£a, where £ is a functional 
variable, is true if, for every functional constant y with the 
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same number of arguments as |, the evaluated formula 
S^a is true; otherwise the evaluated formula V£a is false. 

Now that we have defined the value of an evaluated for- 
mula, we know how to determine the value of a closed for- 
mula of the extended language of arithmetic as a special 
case. This special case will be especially important for us 
later on. 

Example 4. The closed formula 

Vx x \/x 2 (V^ (v x fa) = v x (x 2 ))-+ (x 1 = x 2 )) y 

which says "if the values of all admissible functions at x x 
and x 2 are the same, then x x = x 2 , "is true for either of the 
two interpretations of the set of admissible functions (all 
functions or only finite functions). 
Example 5. The closed formula 

Vv x 3x x Vx 2 (v x ((x x + x 2 )) = 0), 

which says that "every admissible function is equal to for 
all sufficiently large values of the argument," is true if 
admissible functions are the finite functions, and it is false 
if the class of admissible functions consists of all functions. 
Example 6. The closed formula 

Vw 1 3y 1 Vj: 1 (u x (x x ) = w x (x x , x x )) 

is true for either interpretation of admissible functions. 

Example 7. The following closed formula says that there 

exists an admissible one-to-one correspondence between D\l 2 

and N: 

3w x (Vx x 3x 2 3x 3 (w x (x 2 , x z ) = x x ) 

AVz 2 Vz 3 V;r 4 Vz 5 ((w x (x 2i x 3 ) 
= w x (Xt, x 5 ))-> ((x 2 = xj A (*a = *s))))- 

It is true if we take all functions to be admissible, and it is 
false if we take only the finite functions. 

Example 8. The statement that "the inequality 2** ^ x x 
holds for all x x can be translated into the following formula 
in the extended language of arithmetic (with either of the 
two interpretations of admissible^functions): 

VsxVi^fo (0) 

= 1) A Vz 2 ([*,< x x \-+ {vj, ((*, + 1)) 

«= (2^i M)))-»-[«i<»i(«i)l). 
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Here to^^J denotes the formula zta^to + # 3 ) = x x ), 
and Ixi^i v x (x x )] denotes the formula 3x 3 ((x 1 + x 3 ) = 
v i to))- This closed formula can be read as follows: 
"if v x is the sequence of natural numbers whose first term is 1 
and each of whose successive terms through the (x l + l)th 
term is twice the previous one, then v x to)S^ x x " The stip- 
ulation "through the (x x + l)th term" is necessary if only 
finite functions are admissible. 

In Appendix B we interpreted formulas in the language 
of arithmetic which have parameters as expressing proper- 
ties of the natural numbers. In the same way we may regard 
formulas in the extended language of arithmetic as express- 
ing properties of natural numbers and functions. 

Example 9. The formula 

3*3 (to to) + *s) = v i to)) 

expresses the following property: the value of the admissible 
function v x at the number x x is not less than its value at the 
number x 2 . This last statement is not phrased completely 
correctly, since v x is a functional variable and not a func- 
tion, and x x and # 2 are numerical variables and not numbers. 
The phrasing is an abbreviated way of saying, u The result 
of substituting numbers n x and n 2 in place of x 1 and x 2 and 
substituting a functional constant describing an admissible 
function in place of u x is a true evaluated formula of the 
extended language of arithmetic (with either of the two 
interpretations of admissible functions) if and only if the 
value of this admissible function at n x is no less than its 
value at rc 2 ." 
Example 10, The formula 

Vx x Vx 2 3x 3 ((v x (x x ) + x 3 ) = v x ((x x + x 2 ))) 

expresses the property that "the admissible function v x is 
a nondecreasing function." 

Even if we only look at formulas in the extended language 
of arithmetic which have no functional parameters, we still 
have new possibilities that were absent in the earlier lan- 
guage of arithmetic. 

Example 11. The formula 

3M((M0) = 1) A V* 3 (to<*i] 

-+ to (to + i)) = (2^i to))))) A to to) = *■)). 

where lx 3 ^ x x \ is, of course, an abbreviation for 3x 2 (to + 
x 2 ) = z x ), expresses the property mentioned at the begin- 
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ning of Appendix C: "x 2 = 2**." This holds for either of the 
two interpretations of admissible functions; if all func- 
tions are admissible, then we do not need the stipulation 

The properties of natural numbers which are expressible 
by formulas in the extended language of arithmetic will be 
called analytic properties or weakly analytic properties, 
depending on whether we are taking the admissible functions 
to be all functions or only the finite functions. We shall 
identify properties with the sets of objects having the prop- 
erties, and so shall also speak of analytic and weakly 
analytic sets. 

More precisely, let a be a formula in the extended lan- 
guage of arithmetic not having any functional parameters 
and not having any numerical parameters other than 
x x , . ., x k . Let n XJ . ., n h be a set of k numbers. If we 
substitute these numbers in place of the respective varia- 
bles x x , ., x hl we obtain a closed formula in the extended 
language of arithmetic. We shall say that the set of /c-tuples 
(n^ . ., n h ) for which this closed formula is true is associat- 
ed with the formula a (if we are taking all functions to be 
admissible) or weakly associated with a (if only the finite 
functions are admissible). A set which is associated (or weak- 
ly associated) with a formula in the extended language of 
arithmetic will be called an analytic set (respectively, 
a weakly analytic set). 

Example 12. As Example 11 shows, the set {{x ly x 2 ) \ x 2 = 
2* 1 } is both analytic and weakly analytic. 

Any arithmetic set is obviously both analytic and weakly 
analytic. We shall later prove that all weakly analytic sets 
are arithmetic. But not all analytic sets are arithmetic. 
It can be shown that the set of numbers of the true statements 
in the language of arithmetic (in any numbering of A) is 
analytic; but this set is not arithmetic, by Tarski's theorem 
(see Appendix B). We note in passing that an argument simi- 
lar to the proof of Tarski's theorem can be used to show that 
the set of all closed formulas in the extended language of 
arithmetic which are true when one takes all functions to be 
admissible, is not an analytic set. 

In the next subsection we prove that the graph of any 
address-computable function is a weakly analytic set. When 
combined with the result mentioned above about arithme- 
ticity of any weakly analytic set, this will allow us to con- 
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elude that any address-computable function is arithmetic. 

C.3. Expressibility of Address-Computable Functions in 
the Extended Language of Arithmetic. In this subsection we 
shall prove that the graph of any address-computable func- 
tion is a weakly analytic set. Later (in Subsecs. C.4-C.6) we 
shall prove that any weakly analytic set is arithmetic; 
this will then complete the proof that address-computable 
functions are arithmetic, and so sets which are enumerated 
by such functions are also arithmetic. 

Let p be an address program. We shall prove that certain 
properties connected with the program p are expressible in 
the extended language of arithmetic. In what follows, when 
we refer to the truth of evaluated formulas in the extended 
language of arithmetic, we shall always be interpreting 
admissible functions to be only the finite functions. 

Recall that an address machine state is a sequence of 
natural numbers all but finitely many of which are zero. 
Such state is nothing more nor less than a finite function. 

Lemma C.l. The property "the state v 2 is the immediate 
result of applying the program p to the state v" is expressible 
in the extended language of arithmetic. (This means that there 
exists a formula a in the extended language of arithmetic 
with the one-place functional variables v x and v 2 as its param- 
eters such that the result of substituting two functional 
constants describing finite functions in place of v ± and v 2 is 
true evaluated formula if and only if the state described by 
the second functional constant is the immediate result of apply- 
ing the program p to the state described by the first functional 
constant.) 

^ Given a program p, we shall describe how to construct 
the required formula. (Of course, the formula itself will de- 
pend on p.) Our formula a will have the form a t /\ . /\a n 
(where it makes no difference how the parentheses, which we 
have omitted, are inserted). Here n is the number of com- 
mands in the program, and the formula a t corresponds to the 
ith command. Each a t is one of seven types of formulas, 
depending on which of the seven types of commands for 
address machines is the ith command in the program. The 
formulas are constructed by following along the seven parts 
of the definition of the immediate result of applying an 
address program. We shall explain how this is done using 
two examples. 

Example 1. Suppose that command 37 has the form 
37 R (16)+-i? (2).i? (16). 
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In this case the formula a 37 is as followsl 

( Vl (0) = 37)-* (Vx x n( Xl = 16)-* (v 2 (( Xl + 1)) 

= "i ((*i + 1)))) A (»* (17) = (v t (17).^ (3)))). 
Example 2. Suppose that command 81 has the form 
81 IF R (3) = R (4) GO TO 7 ELSE GO TO 23. 
In this case the formula a 8l is as follows: 

( Vl (0) = 81) -* (\/ Xl (v 3 ( Xl + i) = v t (x t + 1)) A ((("i (4) 
= "I (5))-> (v 2 (0) = 7)) A Oi (4) = ^ (5))-*- (i;, (0) 

= 23)))). 

This completes the proof of the lemma. ■ 

Our next step is to construct a formula which expresses 
the property of "being a protocol for applying an address pro- 
gram p of length x x + 1 ." A protocol is a sequence of states, 
i.e., a sequence of finite functions. 

Our language does not have sequences of functions as such, 
but it does have objects which amount to the same thing. 
Namely, we shall identify a sequence of functions 5°, s 1 , . . . of 
one variable with the function S (n> m) of two variables, 
which is defined by setting S (ra, m) = s n (m). Thus, we shall 
say that an everywhere defined function S from N 2 to IN 
describes a protocol for a program p of length k + 1 if the 
sequence s°, . . ., s* of functions of one variable which are 
defined by setting s l (x) = S (i, x) is a protocol for applying 
the address program p. 

Lemma C.2. There exists a formula (J which has a two-place 
functional variable w lf two one-place functional variables v x 
and i; 2 , and a single numerical variable x x as its parameters 
and which expresses the following property: 

"w x describes a protocol of length x x + 1, 

v ± is the initial state of this protocol, and 

v 2 is the final state of this protocol.' 1 
^ The desired formula has the following form: 

((K = <]A^ = ^])A(^(0) = 0)) 

-*[i> 4 is the immediate result of applying p to v 3 ]). 

Here [v x = w[] is an abbreviation for the formula 
V# 3 (v t (x z ) = w x (0, x 3 ))\ [v A = u>i ,+1 ] is an abbreviation 
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for Va? 3 (v A (x 3 ) = w x ((x 2 + 1), # 3 )), and [v 2 = w**] and 
[v 3 = w x i*] are to be interpreted analogously; and, finally, 
[y 4 is the immediate result of applying p to t> 3 ] denotes the 
formula in Lemma C.l with the variables u 1 and v 2 replaced 
by v 3 and i> 4 , respectively. ■ 

We are now ready to prove that the graph of an address- 
computable function is weakly analytic. 

Theorem C.l. The graph of an address-computable junc- 
tion from H h to IN is a weakly analytic set, 
^ Let / be an address-computable function from N ft to Hsl 
and let p be an address program which computes /. The 
graph of / consists of the (k + l)-tuples (x u ., x hi Xh+i) 
for which there exists a protocol w 1 of some length with 
initial state v x and final state v 2 such that 

u t (0) = 1, v x (1) = x ly v x (k) = x k , 

v i ( x ) = for x^ k + 1, v 2 (1) = a; ft+1 . 

If we write all this as a formula in the extended language 
of arithmetic, we obtain the desired formula— a formula with 
which the graph of / is weakly associated. The theorem is 
proved. ■ 

In the next subsections, C.4-C.6, we prove that any 
weakly analytic set— and hence the graph of any address- 
computable function — is an arithmetic set. 

C.4. Reducing the Extended Language of Arithmetic to 
the Usual Language of Arithmetic. In this subsection we 
shall prove that any weakly analytic set is arithmetic, 
i.e., that adding to the language of arithmetic variables 
which run through all the finite functions of one or two 
natural variables does not increase the expressive possibili- 
ties of the language. As noted above, the condition that the 
functions be finite is essential: adding variables which run 
through all functions does result in a significantly more 
expressive language. 

We first give a rough explanation of why the addition of 
variables denoting finite functions does not have any essen- 
tial effect. The point is that these functions form a countable 
set, they can be labeled by the natural numbers (and this 
labeling turns out to be arithmetic in a sense that will be 
made precise below), and then we can speak of a function's 
label rather than the function itself. In this way we can 
limit ourselves to working with the natural numbers. 

We now make this more precise. Suppose that v is a map 
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tyhich associates an everywhere defined finite function of 
one variable to every element of IM ft , i.e., to every Zc-tuple 
of natural numbers. We call such a map a labeling of the 
finite junctions of one variable by means of elements of IN ft if 
each finite function corresponds to at least one (and per- 
haps more) elements of U h . If a &-tuple (a x , . ., a k ) 
corresponds to a function s i then we call this ft-tuple a label 
for s (in the particular labeling system). We say that a la- 
beling is arithmetic if the set 

{(a x , . . *, a h , x> y H ) \ the value of the finite function 
with label (%, ., a k ) at the number x is equal to y) 

is an arithmetic set. 

The key step in our proof that weakly analytic sets are 
arithmetic is the following claim: 

(*) for some k there exists an arithmetic labeling of the 
finite functions by means of elements of U k . 

In Subsecs. C.5-C.6 we shall give two different proofs of 
this claim. In the remainder of Subsec. C.4 we shall show 
how the claim implies arithmeticity of weakly analytic sets. 

We could give a definition of an arithmetic labeling of 
everywhere defined finite functions of two variables by 
analogy with the above definition of an arithmetic labeling 
of finite functions of one variable. It turns out that the ex- 
istence of such a labeling follows from the existence of an 
arithmetic labeling for finite functions of one variable. 
Namely, if we want to label a function / from M 2 to N, 
we first label its "cross-sections," i.e., the functions f n (x) = 
j (n, x), and we then label the sequence made up from 
the labels of the cross-sections. More precisely, we have the 
following easily proved lemma: 

Lemma C.3. If v is an arithmetic labeling of the finite 
functions of one variable by means of elements of IN*, where 
(0, 0, . .,0) is the label of the zero finite function, then the 
following function \i is an arithmetic labeling of the finite 
functions of two variables by means of elements of U h . \i 
associates the k 2 -tuple (a^, ., a£, . . ., a*, . . ., a k ) to the 
function from iNI 2 to IN whose value at the pair (/?, q) is 

v (v (aj, ., at) (p), M v (a*, . ., a h k ) (p)) (q). 

It is easy to see that the restriction that (0, 0, . ., 0) 
be the label of the zero function is not essential. Any arith- 
metic labeling can easily be changed so as to have this 
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property, by simply interchanging two labels; the resulting 
labeling is still arithmetic. 

Thus, we suppose that we have some fixed arithmetic label- 
ing v of the finite functions of one variable by means of 
elements of IN*, and also some fixed arithmetic labeling \i 
of the finite functions of two variables by means of ele- 
ments of N\ 

For each formula in the extended language of arithmetic, 
we shall construct its "translation," which is a formula in 
the language of arithmetic which says the same thing as the 
original formula, but about the labels of functions rather 
than the functions themselves. For convenience, we shall add 
to the language of arithmetic some new variables for num- 
bers: k new variables V\, ., V\ for each one-place func- 
tional variable^ in the extended language of arithmetic, and 
h new variables W\, ., W\ for each two-place functional 
variable w t . Clearly, the class of arithmetic sets is not 
affected by this addition— it makes no difference what 
names one has for variables! We now give a precise T definition 
of the translation of a formula. 

Suppose that a is a formula in the extended language of 
arithmetic having numerical parameters x p , x p , 

one-place functional parameters v q , ., v q , and two-place 
functional parameters w T , w r . Let p be a formula of 

the (usual) language of arithmetic whose parameters are 
a subset of {x Pi , ., x Vm , Vj t , ., V qt , ., V* n , ., Fg n , 
W^, ., W\, ., W % ra , W h T$ ). Then p is called 

a translation oi a if, for any natural numbers x p , .,# p , 
V\ ., Vg n , Wl , ., Wr 8 , the result of substituting 

these numbers in place of the corresponding variables in (J 
is a true statement in the language of arithmetic if and only 
if the result of substituting x p , x v , v (V q , 

v h qi ), v (v> n , v h gn ), v(w\, ' W\), 

., [x (W\. , W 1 ^) (more precisely, numerical and 

functional constants which describe these numbers and 
functions) in place of x p , ., ar p , v q , ., v q , w Tl , 

w r in the formula a is a true evaluated formula of 

' s 

the extended language of arithmetic. 

Theorem C.2. Every formula in the extended language of 
arithmetic has a translation, 
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Before proving this theorem, we remark that a special 
case of the theorem— the case of formulas having no function- 
al parameters — obviously implies our claim that weakly 
analytic sets are arithmetic: if a set is weakly associated 
with a formula in the extended language of arithmetic, then 
the same set is associated with the translation of this for- 
mula. 

^ Assuming for now that translations have been constructed 
for the elementary formulas in the extended language of 
arithmetic, we shall show how to build up translations of 
the other formulas. 

Lemma C.4. 1° // P is a translation of a, then ~~|P is a trans- 
lation of ~"]a; 

2° if p x and p 2 are translations of a x and a 2 , then 

(Pi A P.), (Pi V P.), (Pi-* P.). (Pi ** P«) 

are translations, respectively, of the formulas 

( a i A a 2)> («i V «2)» (ai-^«2). ( a i ^^2); 

3° if P is a translation of a and Q is one of the symbols V 
or 3, then: 

Qx$ is a translation of Qa^a, 

QV\. QViP is a translation of CU^a, and 

QW\. QW^fi is a translation of Gw t a, 

This lemma follows immediately from the definition of 
a translation and the definition of the truth value of formu- 
las. Because of the lemma, our task is reduced to translating 
the elementary formulas, i.e., formulas of the form (t = u), 
where t and u are terms in'the extended language of arithmet- 
ic. If we replace this formula by 3£ ((t = £) /\ (u = £)), 
where E is a numerical variable which does not appear in 
either t or u, and use parts 2° and 3° of the lemma, we see 
that it suffices to translate formulas of the form (t = g), 
where Ms a term and | is a numerical variable. We prove 
that such a translation can be constructed using induction 
on the number of steps in the construction of the term t: 

1° if t is a variable or number, then the formula is its own 
translation; 

2° if t is (u t + u 2 ), then we replace the formula ((u x + 
"2) = £), by 

3th 3t] 2 (((«! = r\ x ) A ("2 = *li)) A (E = (% + ijj))), 
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where t^ and ti 2 are numerical variables different from £ 
:and not occurring in t, and then use the induction assumption 
;and Lemma C.4; 

3° the case when t is of the form fa*u 2 ) is analogous to 2°; 

4° if Ms p (u), where u is a term and/? is a one-place func- 
tional variable, then we first replace the formula (p (u) — 
:£) by 3r] ((u = r|) /\ (p (t\) = £)), where T| is a numer- 
ical variable different from | and not occurring in u; hence, 
lit suffices to be able to translate a formula of the form 
ip On) = £)> an ^ this is possible because of our assumption 
that an arithmetic labeling exists; 

5° the case when t is of the form r fa, u 2 ), where u x and u 2 
are terms and r is a two-place functional variable, is analo- 
gous to 4°. ■ 

Example i. A translation of the formula 

V*i fa (*i) = v 2 fa)) 
is: 

Vxt 3x 2 ([the value of the one-place function with 
label (V\, ., V\) at the number x x is x 2 ] /\ [the value of 
the one-place function with label (V\, V\) at the 

number x 1 is x 2 ]), 

where the bracketed notation denotes the formulas in the 
language of arithmetic which express the properties de- 
scribed there. These formulas exist because there exists an 
Arithmetic labeling. 

Thus, in order to complete the proof that weakly analytic 
sets are arithmetic, it remains only to construct an arithmet- 
ic labeling of the finite functions of one variable. 

€.5. First Method of Constructing an Arithmetic Labeling— 
Godel's Method. We begin with the following observation: 
it is enough to prove that there exists an everywhere defined 
arithmetic function p fa, x t , y) with the following 

property: 

(*) for every finite sequence of natural numbers n , . n k 
there exist a l9 ., a t such that p fa, a t , 0) = n , 

P fa, . ., a u 1) = /?!, ., p fa, ., a t , k) = n k . 
(Here the values of p fa, ., a i} y) iory > k can be arbit- 
rary.) Suppose that p has this property. Let v be the map 
which to every (i + 1)- tuple (x x , . ., x t , h) associates the 
finite function s (y), which equals P fa, ., x t , y) for 
y ^ h and equals for y > h. Then v is an arithmetic 
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labeling of the finite functions of one variable by means of 
elements of N i+1 : it is a labeling because of (*), and it is 
arithmetic because (5 is an arithmetic function and the 
condition y ^ h is an arithmetic property. 

Thus, it suffices to construct a function of i + 1 variables 
satisfying (*) for some natural number i. Following Godel, 
we take our function to be 

P (xu x n V) = ( tne remainder 

when x t is divided by x 2 (y + 1) + 1) 

The arithmeticity of this function follows from the arith- 
meticity of the property "x z is the remainder when x x is di- 
vided by x 2 " which is expressed by the formula lx 3 < x 2 ] 
A 3x 4 (ar t = ((# 2 - £4) + £3))* where [x 3 < x 2 ] denotes 
the formula 3x 5 (((x 3 + x 5 ) + 1) = x 2 ). To prove 
(*), we must use some simple facts from number theory, 
whose proofs can be found in most introductory textbooks 
on the subject. For the rest of this subsection we shall say 
"number" when we mean "natural number." 

A number a is called a divisor of a number b if a = be 
for some c. If a is a divisor of b and <?, then it is a divisor 
of b + c and of b — c. A prime number is a number p >> 1 
which has no divisors other than 1 and p. Every number 
can be written as a product of prime factors, and in essen- 
tially only oneway, i.e., two factorizations can differ only 
in the order one writes the prime factors. If a product of 
several numbers is divisible by a prime p, then at least 
one of the factors is divisible by p. Two numbers a and b 
are said to be relatively prime if they have no divisors in 
common except for 1. The numbers a and b are relatively 
prime if and only if their factorizations into a product of 
primes have no prime factors in common. If a x , ., a n 
are pairwise relatively prime, and if b is divisible by each a u 
then b is divisible by a X 'a 2 m . .'#n« 

Suppose that a , ., a k are pairwise relatively prime. 
We now consider the question: what (k + l)-tuples (r , . 
. . ., r h ) of remainders are possible when a number x is 
divided by a , ., a h ? The remainder when x is divided by 
a t is one of the numbers 0, 1, . ., a t — 1; thus, there are 
a *a X '. ,-a h possible (k + l)-tuples of remainders. The 
next lemma says that all these possibilities actually occur. 

Lemma C.5 (the "Chinese remainder theorem"). Suppose 
that a , . . . , a h are pairwise relatively prime, andr 9 , . . ., r^ 
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satisfy ri<Za t for all i. Then there exists a number x having 
remainder r t when divided by a t , for each i. 
^ We shall call two numbers equivalent if they give the 
same remainders when divided by each of the a t . If two 
numbers are equivalent, then their difference is divisible 
by each a z -, and hence by a - . .-a k (here we use the relative 
primality of the a t ). Thus, no two of the numbers 0, 1, ., 
a -. .«a ft — 1 are equivalent, i.e., each of these numbers 
has a different (k -\- l)-tuple of remainders. But there are 
exactly as many of these numbers as there are possible 
(k + l)-tuples of remainders. Thus, any (k + l)-tuple 
(r > •» r h ) for which r t < a t for each i is a (k -\- l)-tuple 
of remainders obtained by dividing some x by a , . ., a h . ■ 
Lemma C.6. For any n we can find a number b such that 
fc + 1, 26 + 1, . , 726 + 1 are pairwise relatively prime. 
The number b can be chosen to be larger than any number 
specified in advance. 

^ We first note that if p is a common prime divisor of kb + 
1 and hb + 1, then p is a divisor of their difference 
(k — h) b. But p cannot divide 6, since if it did we would 
obtain a remainder of 1 when kb + 1 or hb + 1 is divided 
by p. Hence k — h is divisible by p. From this it follows 
that b + 1, ., nb + 1 will be relatively prime if they 
have no common divisors less than n. This can be accom- 
plished, for example, by taking b to be a multiple of 1-2- 

. .-n\ then the numbers b + 1, ., nb + 1 will each 
give a remainder of 1 when divided by any number from 2 to 
n. This completes the proof of the lemma. ■ 

We can now easily prove the property (*) for our func- 
tion p. Namely, suppose that rc , ., n h are arbitrary natural 
numbers. We have to find x x and x 2 such that the remainder 
when x 1 is divided by x 2 (i + 1) + 1 isn t for z'^ k. Accord- 
ing to Lemma C.6, we can find x 2 such that the numbers 
;r 2 +l, ., x 2 (k + 1) + 1 are pairwise relatively prime 
and x 2 is greater than any of the numbers ?2 , n h . It 

finally remains to choose x x using Lemma C.5. 

This completes the construction of an arithmetic labeling 
by Godel's method. In the next subsection we shall look at 
another method of constructing an arithmetic labeling, 
without the use of number-theoretic considerations. This 
second method is due to R. M. Smullyan (see his book Theory 
of Formal Systems, Princeton, 1961). 

C.6. Second Method of Constructing an Arithmetic Label- 
ing — Smullyan's Method, We first introduce the notion of 
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an arithmetic labeling of finite subsets of (N by natural 
numbers, which is analogous to the notion of a labeling of 
finite functions by means of elements of IN 1 . Namely, a func- 
tion x which associates a subset of IN to every natural 
number is called a labeling if every finite subset of IN is 
the value of x at some natural number. If x (y) = A, we 
shall call y the label of the set A (relative to the la- 
beling t). A labeling is said to be arithmetic if the set 

{(x, y) | x e t (y)} 

is an arithmetic subset of IN 2 . 

Note that we do not require that all of the subsets corre- 
sponding to natural numbers be finite. (Here the analogy 
with the definition of a labeling of finite functions breaks 
down.) 

We shall later show that arithmetic labelings of the 
finite subsets of IN by natural numbers exist. But before 
proving this, we shall show how this fact implies the exis- 
tence of an arithmetic labeling of the finite functions of one 
variable. Thus, suppose that we have an arithmetic labeling 
t of the finite subsets of IN by natural numbers. 

Lemma C.7. There exists an arithmetic function from IN 2 
to IN which is defined on all of W 2 and takes distinct elements 
of IN 2 to distinct elements of IN. 

)► We take the function which takes a pair {n XJ n 2 ) to the 
number which is the smallest label of the set [n^ n x + ^2}- 
In other words, the value of this function at (w 1? n 2 ) is equal 
to k if and only ii n x £ x (&), n x + n 2 g x (k), any number 
belonging to x (k) is equal to either n x or n x + ra 2 , and any 
number less than k does not have this property. All of this 
can be written as a formula in the language of arithmetic, 
and so our function is arithmetic. That this function ta- 
kes distinct pairs to distinct numbers follows easily from 
the definition. ■ 

We now construct an arithmetic labeling of the finite 
subsets of IN 2 by natural numbers. Namely, we let the num- 
ber k correspond to the subset of IN 2 consisting of pairs 
{x, y) for which v (x y y) belongs to the set x (k), where 
v is the function in Lemma G.7 and x is an arithmetic label- 
ing of the finite subsets of IN by natural numbers. It is 
easy to see that every finite subset of IN 2 corresponds to 
some number, and that the set {(&, x, y) | the pair (x, y) 
is in the subset of IN 2 corresponding to the number &} 
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is an arithmetic subset of N 3 . (Of course, these two require- 
ments are what we had in mind when we spoke of construct- 
ing an arithmetic labeling of the subsets of IN 2 .) 

We are now ready to construct an arithmetic labeling of 
the finite functions of one variable by means of elements 
of N 2 . We must describe the function s that corresponds to 
the pair of natural numbers (k, h). Let A be the subset of 
N 2 which corresponds to k under our arithmetic labeling 
of the subsets of M 2 . Given a number x ^ h, if there exist y 
for which (x, y) £A, then s (x) is equal to the smallest 
such y; if no such y exists, then s (x) = 0. Given a number 
x > h, we set s (x) = 0. The function corresponding to any 
pair (k, h) is a finite function, since it is zero for values 
of the argument greater than h. To find a label for a given 
finite function s, we first take h to be the greatest number at 
which s has a nonzero value, and then take k to be the label 
of the set {(x, y) \ x ^ h and y = s (x)}. If we write the 
definition of the labeling we just constructed as a formula 
in the language of arithmetic, we see that the labeling is 
indeed arithmetic. 

To complete the proof by Smullyan's method of the exis- 
tence of arithmetic labelings of finite functions, it thus 
remains for us to construct an arithmetic labeling of the 
finite subsets of N. In the construction we shall make use 
of the binary system for writing integers. 

The binary representation of a natural number (except 
for 0) always begins with a 1 . If we agree to drop that initial 1 , 
then we obtain a one-to-one correspondence between the 
set of all positive integers and the set of all words in the 
alphabet {0, 1}. That is, the instruction "Take the number, 
add 1 to it, write the result in binary, and drop the initial 1" 
gives a one-to-one correspondence between the set of natural 
numbers and the set of words in the alphabet {0, 1}, as 
follows: 

empty word 

1 

2 1 

3 00 

4 01 

5 10 

6 11 

7 000 

8 001 
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The words in the right column are in order of increasing 
length, with words of the same length arranged in alpha- 
betical order. We shall call an integer in the left column the 
"number" of the word in the right column in the same row. 
In this numbering every set of (binary) words corresponds 
to a set of natural numbers. For example, the set of words 
consisting only of zeros corresponds to the set of numbers 
which are one less than a power of two. Using this numbering, 
we say that a set of words is arithmetic, meaning that the 
corresponding set of natural numbers is arithmetic. We shall 
also say that a property of words is arithmetic if the set 
of words satisfying the property is arithmetic. We similarly 
define the notion of an arithmetic subset of ({0, l}°°) n , 
the set consisting of all ra-tuples of words, and speak of an 
arithmetic property of rc-tuples of words. 

We now show that certain concrete properties are arith- 
metic. 

1° The word X comes before the word Y in the above 
ordering. In fact, this holds if and only if the number of X 
is less than the number of Y 

2° The word X consists only of zeros. Here, by what was 
said above, it suffices to verify arithmeticity of the property 
of "being a power of two," and this follows, as explained 
in Appendix B, from the fact that a number x is a power of 
two if and only if every divisor of x is either 1 or an even 
number. 

3° The word X consists only of ones. In fact, a word con- 
sists only of ones if and only if the succeeding word consists 
only of zeros. 

4° The word Y consists only of zeros and has the same 
length as the word X, In fact, this is equivalent to requiring 
that the number of Y be the largest among all numbers of 
words consisting only of zeros which do not exceed the 
number of X. 

5° The words X and Y have the same length. This is 
equivalent to the existence of a word Z consisting only of 
zeros and having the same length as X and the same length 
as Y; so arithmeticity follows using 4°. 

6° The word X is the concatenation of the words Y and Z, 
i.e. , it is obtained by writing Z after Y to the right, X = YZ. 
This is the most difficult in our list of arithmetic properties. 
Here the argument requires that we recall our particular 
method of numbering words. Roughly speaking, this^prop- 
erty is arithmetic because the number x whose binary 
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tepresentation is obtained by joining tbe binary represen- 
tations of y and z, is obtained by multiplying y by 2< ien s thof z) 
and adding z. Of course, we must take into account that our 
numbering system for words involves adding 1 and then 
dropping the first 1 in the binary representation. We now 
go through the argument in more detail. 

Let #, y and z be the numbers of the words X, Y and Z. 
This means that x + 1 is written as IX in binary, y + 1 
as 1Y, and z + 1 as 1Z. Let u be the number of the word 
having the same length as Z but consisting only of zeros. 
Then u + 1 in binary is 100 ... (with length of Z zeros). 
If X is the concatenation of Y and Z, then multiplying 
y + 1 by a + 1 and adding (z + 1) — (u + 1) gives 
# + 1. We can now conclude that our property is arithmetic, 
since a formula expressing the property in the language of 
arithmetic need only say: "There exists u, which is the 
number of a word of the same length as Z and consisting 
only of zeros, such that (y + l)*(u + 1) + (z — u) is 
equal to x + 1." The clause about having the same length 
as Z and consisting only of zeros can be expressed in the 
language of arithmetic, by 4°. 

The arithmeticity of the property of "being the concatena- 
tion" easily implies that several other properties are also 
arithmetic. 

7° The word X is the beginning of the word Y, i.e., there 
exists a word Z such that Y is the concatenation of X and Z. 

8° The word X is the end of the word Y, i.e., there exists 
a word Z such that Y is the concatenation of Z and X. 

9° The word X is a subword of the word Y In fact, X is 
a subword of Y if and only if it is the beginning of an end 
of Y. 

10° The word X is the concatenation of the words Y, Z 
and V. Here we note that X is the concatenation of Y, Z 
and V if and only if there exists a word W such that W is 
the concatenation of Y and Z and X is the concatenation 
of W and V. 

We can similarly prove for any fixed n that the property 
"Y is the concatenation of X x , . ., X n " is arithmetic. 

We are now ready to construct an arithmetic labeling of 
the finite sets of natural numbers. Suppose that x and y 
are natural numbers, and X and Y are the corresponding 
words. Let U be the longest word consisting only of zeros 
which is a subword of Y. We shall stipulate that the number 
x belongs to the set % (y) if the word IU1X1UI is a subword 
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of Y We now pfove that t is a labeling of the finite sets 
of natural numbers. 

Suppose that {x x , ., x n } is a finite set of natural 
numbers, and {X x , ., X n ) is the set of corresponding 
words. Let U be a word consisting only of zeros which is 
longer than any of the words X Xi X n . We let Y denote 

the word 

lUlXilUlXilUl WlX n Wl> 

Then the number of the word Y will be a label of the set 
{x lt . ., x n }. This labeling is easily shown to be arithmet- 
ic, using the above list of arithmetic properties of words. 
This completes the construction of an arithmetic labeling 
by Smullyan's method. 



D. Languages Connected with Associative 

Calculi 

In this appendix we shall look at examples of languages 
whose sets of true statements are relatively simple in struc- 
ture. These examples are connected with the so-called "asso- 
ciative calculi." 

An associative calculus in the alphabet L is an arbitrary 
finite set of rules which describe a type of transformation 
of words in L. These rules are called two-sided substitutions, 
or simply (since we shall not deal with one-sided substitu- 
tions) substitutions in the alphabet L. Each substitution in the 
alphabet L is written in the form 

P~Q, 

where P and Q are words in L and the symbol «-* is not a 
letter of L. (For example, or «-► er is a substitution in the 
Latin alphabet.) A substitution rule P «-> Q means that 
whenever P occurs as part of another word it can be re- 
placed by Q, and vice versa. We now state this more precisely 
in the form of some definitions. 

Given an associative calculus (i.e., a list of substitutions), 
we introduce the notion of contiguity and equivalence of 
words. Two words A and B are said to be contiguous, de- 
noted A J_ B, if there exist words P\ Q, X and Y such that 
(1) A = XPY, (2) B = XQY, and (3) at least one of the 
substitutions P++Q or Q++P is & substitution in the given 
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fessociative Calculus. A finite secjueiice of words (Ci, , 

. ., C n ) in the alphabet L is said to be a contiguity chain 
if we have C t J_ C i+ i for each i. Finally, we say that two 
Words A and B are equivalent if there exists a contiguity 
fchain (C ± , C n ) such that C± = A and C n = B. 

Remark 1. If we form the quotient of the set L°° by this 
equivalence relation, we obtain an algebraic system with 
an associative operation (coming from the operation of 
Writing words next to one another). This explains the ter- 
minology "associative calculus." 

Suppose we have a fixed associative calculus in the alpha- 
bet L. There exists an algorithm which, given any two 
words A and B in L°°, determines whether or not they are 
contiguous. For example, we could obtain such an algorithm 
by running through all 4-tuples of words P, Q, X, Y of 
length no greater than the maximum length of A and B, 
and then checking conditions (l)-(3). Thus, the set of all 
pairs of contiguous words is a decidable subset of L°° X L°° 
However, it is not at all obvious, except in the simplest 
cases, that there exists an algorithm which determines 
whether or not two words are equivalent. 

Example 1. Suppose that L = {a, 6, c} and the associa- 
tive calculus is given by the following substitutions: 

ab «-> fca, ac «-► ca, be <-> cb. 

Here it is obvious that A and B are equivalent if and only 
if the number of a y s in the word A is equal to the number 
of a's in B, and likewise for b and c. This associative calculus 
is an example of what is called a commutative calculus. 

In the general situation, it is not clear how to construct 
an algorithm which, given two arbitrary words, determines 
whether or not they are equivalent, i.e., whether or not 
there exists a contiguity chain connecting them. In fact, 
A. A. Markov and E. L. Post showed that it is possible to 
find an associative calculus whose equivalence recognition 
problem is undecidable (in other words, for which there is 
no algorithm which determines whether two words are equiv- 
alent). For a proof of the existence of such an associative 
calculus, see, for example, Kleene's book Introduction to 
Metamathematics. Here we shall give without proof an 
example due to G.S. Tseitin. 

Example 2. Suppose that L = {a t 6, c, d, e}> and the 
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associative calculus is given by the following substitutions! 
ac ++ ca, ad «-> da, be ++ cb, bd -<->• db, 
eca ++ ce, edb ++ de, cca <-> ccae. 
Tseitin showed that this associative calculus does not have 
an equivalence recognition algorithm. 

An associative calculus will be said to be decidable if 
there exists an algorithm which recognizes equivalence in 
the calculus; otherwise, the calculus will be said to be 
undecidable. Clearly, decidability of an associative calculus 
is equivalent to decidability of the subset of L°° X L°° 
consisting of all pairs of equivalent words (or decidability 
of the subset of all pairs of inequivalent words). 

Suppose we have a fixed associative calculus 3 in the 
alphabet L. We let T + (respectively, T~) denote the set of 
all words (in the alphabet L*) of the form A * 5, where 
A g L°°, B £ L°°, and A is equivalent (respectively, inequiv- 
alent) to B. Thus, T + (J T~ = L°° X L°° and the calculus 
3 is decidable if and only if T + (or equivalently T~) is 
a decidable subset of L°° X L°°. 

Remark 2. Note that the set T + (or T~) for the calculus 
in Example 2 is one example of an undecidable subset of 
L°° X L°°. The characteristic function of this subset is then 
an example of a noncomputable function. 

Given any associative calculus in an alphabet L, we can 
now speak of two languages connected with it: the positive 
language, whose statements are all possible assertions that 
two words in L are equivalent, and the negative language, 
whose statements are all possible assertions that two words 
in L are inequivalent. In both cases the statements can be 
regarded as elements of the set L°° X L°° In the positive 
language, the word A *B will be interpreted as asserting 
that A is equivalent to B\ hence T + is the set of true state- 
ments. In the negative language, the word A * B will be 
interpreted as asserting that A is inequivalent to B\ hence 
T~ is the set of true statements. 

Recall that in Subsec. 1.1.3 we agreed to define a language 
by giving a fundamental pair. Thus, suppose we have a fixed 
alphabet L and an associative calculus 3 in this alphabet. 
We shall call (L*, T + ) the fundamental pair of the positive 
language connected with 3» and (L*, T~) the fundamental 
pair of the negative language connected with 3. 

We shall be interested in whether there is a complete and 
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consistent deductive system for (L*, T + ) and for (L*, T"). 
We shall see that this question always has a positive answer 
in the first case, while in the second case the answer depends 
upon whether the calculus 3 is decidable. 

Lemma D.l. The set E of all contiguity chains is a de- 
cidable subset of L~. 

^ This lemma follows from the existence of an algorithm 
which determines whether an arbitrary pair of words in L°° 
satisfies the contiguity relation. ■ 

Theorem D.l. In any associative calculus the set of all pairs 
of equivalent words is enumerable. 
^ We define a function q> on L™ by setting 

cp (C 1 * C 2 * * C n ) = C x * C n 

for each word C x * C 2 * . .*C n , where each C t is a word 
in the alphabet L. Then two words A and B are equivalent 
if and only if A * B = cp (C ) for some contiguity chain C. 
That is, T + = cp (E), where E is the set of all contiguity 
chains. The set E is a decidable subset of L~, by Lemma D.l, 
and so is enumerable (by Lemma 2 of Sec. 2). But cp is obvi- 
ously a computable function; hence, the set cp (E) = T + 
is enumerable, as was to be proved. ■ 

Remark 3. Thus, in an undecidable calculus the set T + 
is an example of an enumerable but undecidable subset of 
the enumerable set L°° X L°°. By Lemma 3 of Sec. 2, such 
a subset is also an example of an enumerable set with non- 
enumerable complement. See also Remark 5 below. 

Corollary of Theorem D.l. There exists a complete and con- 
sistent deductive system for the fundamental pair of the positive 
language connected with an arbitrary associative calculus. 
Remark 4. To obtain the deductive system in the corollary, 
there is no need to refer to Theorem 1 of Sec. 2. We can sim- 
ply choose the deductive system (L*, E, cp), where E and q> 
are as in the proof of Theorem D.l; it will be a complete 
and consistent deductive system for the fundamental pair 
(L*, T + ). This deductive system is quite natural from an 
intuitive point of view, since the best way to show that two 
words A and B are equivalent is to exhibit a contiguity chain 
connecting them. 

We now ask about a deductive system for (L*, T~). 
Theorem D.2. Given an associative calculus, the set of all 
pairs of inequivalent words is enumerable if and only if the 
calculus is decidable. 
^ We first recall that L°° X L°° is enumerable (see Exam- 
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pie 6 in Sec. 2). Suppose that the calculus is decidable. Then 
r~ is a decidable subset of L°° X L°°, and so T~ is enumer- 
able, by Lemma 2 of Sec. 2. Now suppose that, conversely, 
T~ is enumerable. Since its complement T + in the enumerable 
set L°° X L°° is also enumerable, by Theorem D.l, it follows 
by Lemma 3 of Sec. 2 that T~ is a decidable subset of 
L°° X L°°, and so our associative calculus is decidable. ■ 

Remark 5. Thus, if we have an undecidable associative 
calculus, T + will be an example of an enumerable set with 
nonenumerable complement (in an enumerable, larger set). 
By Lemma 3 of Sec. 2, any such example is also an example 
of an enumerable set which is undecidable (relative to the 
enumerable, larger set). Thus, the existence of an enumer- 
able but undecidable set, which we proved in Sec. 5, can 
also be obtained as a corollary of the existence of undecidable 
associative calculi. But it should be mentioned that the 
usual proofs that some associative calculus is undecidable 
rely upon the existence of an enumerable undecidable set 
(this is true of Example 2, for instance). Thus, the latter 
fact should be proved without relying upon the existence 
of undecidable associative calculi. 

Corollary of Theorem D.2. There exists a complete and 
consistent deductive system for the fundamental pair of the 
negative language connected with an associative calculus if 
and only if the calculus is decidable. 

Given an arbitrary associative calculus 3 in the alpha- 
bet L, we now introduce its universal language, whose state- 
ments consist both of assertions that two words are equiv- 
alent and assertions that two words are inequivalent. 
Here we need a way to distinguish between the two types 
of statements. For this purpose we add one more letter ~| 
to the alphabet L, where we are supposing that ~~|, like the 
symbols «-► and *, are not letters in L. We let L' denote 
the alphabet L U {*, ~~|}. Now we let ~~\T~ denote the set 
of all words of the form "|P, where P 6 T~. We set T° = 
T + Ul T~, and form the fundamental pair (L\ T°). It is 
natural to interpret an element t of T° as a true statement 
about the equivalence (if t £ T + ) or inequivalence (if t £ ~~| T~) 
of two words. 

Theorem D.3. Given any associative calculus 3, the corre- 
sponding set T° is enumerable if and only if the calculus is 
decidable, 

► If 3 is decidable, then T~ is enumerable, by Theorem D.2, 
and so "J7 7 " is also enumerable (see Example 5 in Sec. 2). 
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Then T° is enumerable, by Lemma 5 of Sec. 3. Now suppose 
that J is enumerable. We form the set ~|L'°° of all words 
in the alphabet 1/ which begin with "]; this set is enumer- 
able (see Examples 2 and 5 in Sec. 2). By Lemma 5 of Sec. 3, 
the intersection T° f]^\ L'°° is enumerable. But T° ft ^L'°° = 
"]r~. Hence ~]T~ is enumerable, and then so is T~ (see 
Example 5 in Sec. 2). But then the calculus 3 is decidable, 
by Theorem D.2. ■ 

Corollary. There exists a complete and consistent deductive 
system for the fundamental pair of the universal language 
connected with an associative calculus if and only if the cal- 
culus is decidable. 



E. Historical Remarks 

One of the truly great mathematicians of the 20th century 
(and undoubtedly the greatest mathematical logician) was 
Kurt Godel. He was born on 28 April, 1906 in Brno, in what 
was Austria-Hungary and is now Czechoslovakia. From 
the 1940s until his death on 14 January, 1978, Godel worked 
at the Institute for Advanced Study in Princeton. The 
name Godel is connected with the most important theorems 
in mathematical logic: the completeness theorem for pre- 
dicate calculus (1930), the incompleteness theorem for 
arithmetic (1930), and the theorem on consistency of the 
axiom of choice with the continuum -hypo thesis (1938). 

The completeness theorem for predicate calculus says that 
it is possible to find a complete and consistent deductive 
system for the language of the logic of predicates. More 
precisely, Godel proved that a particular concrete deductive 
system (that was known before) fulfills this role. Thus, in 
that deductive system one can prove all true statements of 
predicate logic, i.e., any formula which expresses a "law 
of logic"; and it is impossible to prove any other formula. 
Here by a "law of logic" we mean a formula whose truth 
is preserved regardless of the meaning ascribed to the various 
names in the formula. 

On the other hand, the incompleteness theorem for arith- 
metic—to which the present book is devoted— says that we 
do not have this situation in arithmetic. Not only do all 
known deductive systems fail to be consistent or else fail 
to be complete, but it is inherently impossible to find a com- 
plete and consistent deductive system. As explained above 
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in the main text, this means that there is no possible notion 
of a formal proof which would lead to all the truths of arith- 
metic and only the truths of arithmetic being provable. 
Below we shall state the incompleteness theorem in the form 
given by Godel himself. 

The theorem on consistency of the axiom of choice and 
the continuum-hypothesis says that set theory remains con- 
sistent if we add both the axiom of choice and an axiom 
expressing the continuum-hypothesis, provided that it was 
consistent before these two axioms were added. This theorem 
of Godel's was the first fundamental result in the study of 
the consistency of the assertions of set theory. To a large 
extent it changed our way of thinking about the meaning 
of set-theoretic statements, and gave rise to a new line of 
investigation in mathematical logic. 

GodeFs theorems are discussed in more detail in the books 
cited in Bibliography at the end of the book. Godel was 
responsible for many other important concepts and results, 
such as the first definition (in 1934) of the notion of a recur- 
sive function (Herbrand-Godel recursiveness). We shall 
not attempt to list all of Godel's contributions here, rather 
we shall use the remainder of this appendix to describe 
Godel' s original formulation of the incompleteness theorem. 

Godel's famous paper u Uber formal unentscheidbare Satze 
der Principia Mathematica und verwandter Systeme I" 
("On formally undecidable propositions of Principia Mathe- 
matica* and related systems I") was published on p. 173-198 
of the first issue of vol. 38 (1931) of the Leipzig journal 
Monatshefte fiir Mathematik und Physik (it was presented on 
17 Nov., 1930). A preliminary synopsis of the results was 
published in the Viennese journal Anzeiger der Akademia der 
Wissenschaften in Wien, Mathematischnaturwissenschaftliche 
Klasse, no. 19 (1930) (report of meeting held on 23 Oct. , 1930). 

In this paper Godel showed that for a large class of formal 
systems there must inevitably exist an undecidable state- 
ment, i.e., a statement such that neither it nor its negation 
can be derived from the axioms of the given system. The 
paper contained the following theorem (Theorem VI on 
p. 187): 

For every co-consistent recursive class % of formulas 
there exists a recursive class formula r such that neither 



* The epic monograph on mathematical logic by A. Whitehead 
and B. Russell, Principia Mathematica, Cambridge, 1925. 
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v Gen r nor Neg (v Gen r) belongs to Fig (x) (where *; is 
a free variable in the formula r). 

Some words of explanation are needed for this formulation. 
The discussion below will suppose that the reader has a 
rudimentary acquaintance with some facts from mathemati- 
cal logic. 

Godel's theorem here is speaking of the formulas in a cer- 
tain formal system P, which is constructed on p. 176-178 
of the paper. Rather than taking the time for a precise 
description of this formal system, we shall be content simply 
to give the following quotation from Godel: "In essence, P 
is the system which is obtained if one supplements the Peano 
axioms with the logical structure of Principia Mathematica 
(with numbers as the individua and the 'follows after' 
relation as an undefined notion)" (p. 176). 

The italics in Godel's theorem have a special meaning. 
They indicate that we are not speaking directly about symbol 
combinations in the formal system (variables, formulas, 
etc.), but are rather referring to the numbers of these symbol- 
ic expressions in some fixed numbering system (now called 
the Godel numbering). For example, a class formula is a 
formula with one free variable. Hence, a class formula is 
a nonnegative integer which is the number of a class formula. 

The notation v Gen r stands for the number of the formula 
obtained by putting the universal quantifier and the vari- 
able with number v in front of the formula with number r. 
Neg (v Gen r) is the number of the negation of the formula 
with number v Gen r. Fig (x) denotes the class of numbers 
of the formulas which are deducible from the formulas whose 
numbers form the class x. (In the deductions the axioms 
can be used, so that here x can actually be regarded as being 
combined with the axioms of the original system.) 

We shall not define what "recursive classes" and "recursive 
formulas" are. These terms refer to the possibility of de- 
fining the classes and formulas under consideration by means 
of primitive recursive functions (which are called simply 
"recursive functions" in Godel's paper). 

The property that a class be co-consistent is a stronger 
condition than simple consistency. (Later, Rosser strength- 
ened Godel's original formulation of the theorem by showing 
that co-consistency can be replaced with a weaker consistency 
condition.) Whereas a class is consistent if it is impossible 
to derive both a formula and its negation, a class is co-con- 
sistent if it is impossible to derive both a formula of the 
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form "there exists x such that U (x)" and also all formulas 
of the form "not U (0)," "not U (1)," "not U (2)," and so on. 
In the notation of Godel's paper, a class x of formulas (i.e., 
numbers of formulas) is said to be to-consistent if there does 
not exist a class formula a for which: (1) Neg (v Gen a) £ 
Fig (x), and (2) Sb (al (n >) 6 Fig (x) for all n. Here Sb (ai {n) ) 
denotes the number of the result of substituting the formula 
with number Z (n) into the formula with number a in place 
of the variable with number v\ Z (ri) is the number of n. 

Thus, Theorem VI says that for any class of formulas which 
satisfies certain conditions there exists a formula having 
a rather simple form such that neither this formula nor its 
negation can be derived from the class. Since Peano's 
axioms of arithmetic are the central ingredient in the formal 
system P upon which this theorem is based (recall that the 
theorem refers to the formulas of this system and deducibil- 
ity using the rules of this system), Godel's theorem is often 
interpreted as a statement about the incompleteness of for- 
mal arithmetic. Here incompleteness should be understood 
from the syntactic point of view (see Appendix A). 

Remark 1. If we regard the system P as being formal arith- 
metic, then the incompleteness of formal arithmetic is only 
a very special case of Theorem VI obtained by taking x = 0. 
Here the theorem guarantees incompleteness provided that 
P itself is co-consistent, i.e., its class of axioms is co-con- 
sistent. In this special case Fig (x) consists simply of the 
numbers of all formulas that are provable in P. 

Remark 2. To be sure, the undecidable formula in Theo- 
rem VI — namely, the formula with number v Gen r — does 
not have an arithmetic character, i.e., it is not written 
in the simplest arithmetic language. However, in this con- 
nection Godel's paper contains some important further 
results. On p. 193 we find the following Theorem VIII: 
In any formal system as in Theorem VI, there exist 
undecidable arithmetic statements. 
Here a formula is said to be "arithmetic" if it is constructed 
using variables indexed by natural numbers, the equality 
relation, and the addition and multiplication operations. 

It should be noted in passing that the symbols =, + 
and are not in the original alphabet of P. Thus, an "arith- 
metic formula" can only really exist in a suitable extension 
of P. In P itself these symbols must be regarded as abbre- 
viations. For example, on p. 177 of Godel's paper, the expres- 
sion x x = y x is defined to be an abbreviation for the formula 
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Jti x 2 U (x 2 (xj) =) x 2 {y x ))" where x 2 U is Godel's notation 
for what we denoted V^ 2 - (Godel's paper does not give the 
analogous definitions for x + y and x — y.) 

Remark 3. As Godel himself noted (p. 190), his proof of 
Theorem VI not only applies to the concrete system P in 
his paper, but also for any system satisfying the following 
two fundamental properties: 

(1) the system's axioms and rules of deduction can be 
defined recursively; 

(2) any recursive relation can be defined within the 
system. 

As Godel notes, these properties hold for the axiom sys- 
tems of Zermelo-Fraenkel and von Neumann for set theory, 
and also for axiomatic number theory based on the 
Peano postulates and recursive definitions. Thus, there are 
undecidable propositions in each of these systems, as 
we see by setting x = in the theorem (see Remark 1 
above). 

Of course, the incompleteness result for each of these 
systems requires that the system be co-consistent. In all 
concrete cases, this consistency should be viewed as a work- 
ing hypothesis, which comes from our belief in the reason- 
ableness of the system, i.e., our confidence that it is a true 
reflection of a certain reality. 



F. Exercises 

This appendix contains exercises for various sections of 
the book. The starred exercises are the more difficult ones. 

Exercises for Sec- 2 

2.1JShow that in any set the union or intersection of two 
decidable subsets is a decidable subset. 

2.2. Show that the union or intersection of two enumerable 
sets is enumerable. 

2.3. Show that if the graph of a function is enumerable- 
then the function is computable. (The converse is proved in 
Sec. 5.) 

2.4. Show that if A c N is decidable (or enumerable), 
then {x | 2x 6 A } is decidable (respectively, enumerable). 

2.5. Show that if A cz IN is enumerable, then B = 

87 



{x I 3 k £ IN (A:x 6^)} is enumerable. (But if A is de- 
cidable, it does not necessarily follow that B is decidable; 
see Exercise 5.16). 

2.6. Show that the set IN 3 of all triples of natural numbers 
is enumerable. 

2.7. Prove that a set A cz IN is enumerable if and only 
if it is a projection of some decidable subset R of the set IN 2 . 

2.8. Show that if A is a decidable subset of B and C is a 
decidable subset of D, then A X C is a decidable subset of 
B X D. 

2.9. Prove that any infinite enumerable set P can be enu- 
merated by a computable function without repetitions, i.e., 
there exists a computable function p defined on all of N 
such that P = {p (0), p (1), .} and p (n) ^= p (m), when 
n =7^= m. 

2.10. Let A be some set of natural numbers. We define the 
direct listing of A to be the function which takes to the 
smallest element in A, 1 to the next smallest element in A, 
and so on. (If A is a finite set, then the direct listing is not 
an everywhere defined function.) Prove that A is a decidable 
subset of IN if and only if its direct listing is a computable 
function. 

2.11. Show that an infinite enumerable set P cz IN always 
has an infinite subset which is a decidable subset of IN. 

2.12. Let A and B be enumerable sets with nonempty 
intersection. Show that there exist enumerable sets A 1 and 
B ± such that A [) B = A x U J? lt A x f) B 1 *£ 0, A 1 cz A, 
B,cz B. 

2.13. Let P be an enumerable subset of N 2 . Show that 
there exists a computable function / from IN to IN which 
is defined on all x such that (x, y) 6 P for some y and whose 
value at such an x is one of those y's (i.e., (x, j (x)) £ P 
for all x on which / is defined). 

2.14. Derive the fact in Exercise 2.12 as a consequence 
of Exercise 2.13. 

2.15. A set A of natural numbers is said to be computably 
infinite if there exists an algorithm which, given n, finds 
a list of more than n distinct elements of A. Prove that 
the following properties are equivalent: 

1° A is computably infinite; 
2° A contains an infinite enumerable subset; 
3° A contains an infinite subset which is a decidable 
subset of IN; 
4° there exists a computable function from Jsl to IN which 
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is defined on all natural numbers and has that property 
that / (n) 6 A and / (n) ^ n for all n. 

2.16*. Prove r that there exists an infinite set which is 
not computably infinite. 

2.17. Prove that the following function / is computable: 
/ (n) = 1 if one can find at least n nines in a row in the 
decimal expansion of it; / (n) = otherwise. (If we replace 
"at least" with "exactly" in the last sentence, then it is not 
known whether or not the resulting function / is com- 
putable.) 

2.18*. Is the following a decidable subset of N 2 : take all 
pairs (rci, n) of natural numbers such that n*fc and 
mln < el (Here e is the base for natural logarithms.) 

2.19*. Is the function which takes the natural number n 
to the nth digit in the decimal expansion of e a computable 
function? 

2.20. Show that the following conditions on a real number 
x are equivalent: 

1° there exists an algorithm which, given w, finds p and q 
such that q^= and | p/q — x | < 1/w; 

2° the set {(p, q) \ q^= and p/q < x} is decidable; 

3° the function which takes n to the rath digit in the 
decimal expansion of x is computable. 

If the conditions in Exercise 2.20 hold, then x is called a 
computable real number. 

2.21*. (Continuation of Exercise 2.20.) The sum, product, 
or quotient of two computable real numbers is computable; 
and any root of a polynomial with integer coefficients is 
computable. Prove these facts. 

2.22. (Continuation of Exercise 2.20.) Prove that there 
exist real numbers which are not computable. 

Exercises for Sec. 3 

3.1. We say that an everywhere defined function / from 
K°° to L°° reduces the set A a K°° to the set B c= L°° if 
the conditions x £ A and / (x) £ B are equivalent for all 
x 6 K°° (Thus, we "reduce" the problem of whether x be- 
longs to A to the problem of whether / (x) belongs to B.) 
Show that if B is decidable (or enumerable) and if there is 
a computable function which reduces A to B y then A is also 
decidable (respectively, enumerable). 

3.2. (Continuation of Exercise 3.1.) Show that if A is 
undecidable (or nonenumerable) and if there is a computable 
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function which reduces A to B, then B is also undecidable 
(respectively, nonenumerable). 

3.3. (Continuation of Exercise 3.1. ) Show that a set X a !N 
is expressible by means of the fundamental pair (L, T) 
if and only if there is a computable function which reduces 
X to T. 

3.4. We say that two sets A and B of natural numbers are 
almost everywhere equal if their differences A\B and B\A 
are finite* Prove that a set which is almost everywhere 
equal to a decidable set is decidable, and that a set which 
is almost everywhere equal to an enumerable set is enumer- 
able. 

Exercises for Sec. 4 

4.1. Add a new quantifier V e meaning "for all even" to 
the language of arithmetic. That is, V e £a is true if the 
closed formula Sn a is true for all even n. Show that the 
class of arithmetic sets does not change as a result of doing 
this. 

4.2. Let a, p and y be any closed formulas. Show that 
the following closed formulas are true: 

(a) (a A (« - P)) -> fc 

(b) (a A (P V V)) ++ ((« A P) V (« A Y)); 

(c) (a + (|J-> 7 ))~((a AP)">Y); 

(d) ((a -> y) A (P - V)) ~ ((« V P) -> Y); 

(e) (((a -+ p) - a) -> a); 

(f) l(a AP)-(> v HP); 

(g) ~](« VW- (la A HP); 

(h) ((a-*p)A (a-*-]p))-*>; 
(i) (a A » - P; 

0) (a-*P)~(-)a V P); 

(k ) ( a *-> p) ~ ((a - p) A (P -» a)); 

(1) (a VPW1 (la A "IP)- 

4.3. Let a be a formula having no parameters other 
than £. 

Show that the following closed formulas are true: 

(a) V|a — 3£a; 

(b) lV£a ~ 311a; 

(c) ~13Ea +* Vila. 

4.4. Prove that the class of arithmetic sets remains the 
same if we eliminate the symbols V , ->-, «->, and 3 from 
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the language of arithmetic (the symbols "], /\, and V 
remain). 

4.5. Show that the following sets are arithmetic: 

{x | x is divisible by 3} t 

{x j a; is a power of 3}, 

{a; | the last decimal digit in x is 7). 

4.6*. Show that the set {x \ x is a power of 10} is arith- 
metic. 

4.7. Prove that any arithmetic set is associated with some 
formula which does not contain any numbers. 

4.8. Prove that there exists a set which is not arithmetic. 

Exercises for Sec. 5 

5.1. Show that the following properties are equivalent: 
(a) X is an enumerable set; (b) X is the domain of definition 
of some computable function; (c) X is the set of values of 
some computable function. 

5.2. Prove that for every computable function / there 
exists a computable function g with the following property: 
g (y) is defined if and only if y is in the set of values of /, 
and in that case / (g (y)) = y. 

5.3. Prove that if / is a computable function from H 
to N, then the set {x | / (x) = 1986} is enumerable. 

5.4. Show that there does not exist a function from N 2 
to N which is universal for the class of all everywhere 
defined functions from IN to IN. 

5.5. Show that there does not exist a function from IN 2 
to IN which is universal for the class of all functions from 
IN to IN. 

5.6. Let a be a function from which no computable func- 
tion can be everywhere different. Show that the set 
{x | a (x) = 1986} is enumerable and undecidable. 

5.7. Prove that there exists a nonenumerable set with 
nonenumerable complement, and that this set can be chosen 
to be arithmetic. 

5.8. Let F be a computable function from IN 2 to IN. We 
shall call n the number of the function F n relative to F. 
We shall say that the numbering given by a function F' 
reduces to the numbering given by F if there exists an every- 
where defined computable function h from IN to IN which 
takes the F'-number of a function to the F-number of the 
same function, i.e., F h ( n ) = F' n , Show that there exists a 
function F from IN 2 to N such that the numbering given by 
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P* reduces to the numbering given by F for any function F 1 
from W to IN. Show that a function with this property must 
be a universal function. Such functions are called principal 
universal functions. 

5.9. Let F be a computable function from N 2 to N. 
Show that the sets {n \ F n is defined on a nonempty set} 
and {n \ F n takes the value 1986} are enumerable. 

5.10. Show that there is a computable function F from N 2 
to IN such that the set {n \ F n is defined on a nonempty set} 
is an enumerable set with nonenumerable complement. 

5.11. Show that there exists an enumerable set PcN 2 
whose set of lower points, i.e., 

{(x,y)\(x,y)tP and Vy' < y «*, y') $ P)} 9 

is a nonenumerable set. 

5.12. Let P be a subset of IN x IN. Let P n denote the 
set {x 6 IN | (n, x) £ P). Prove that if P is enumerable, 
then all of the P n are enumerable. Show that there exists 
an enumerable set P such that all enumerable subsets of N 
occur among the P n . Such a set P is said to be universal 
for the class of enumerable subsets of IN. 

5.13. (Continuation of Exercise 5.12.) Prove that, if P is 
an enumerable set which is universal for the class of enu- 
merable subsets of IN, then the set {x \ {x, x) § P) is not 
enumerable, and hence {x \ (x, x) g P) is an enumerable 
set with nonenumerable complement. 

5.14. Prove that there does not exist a decidable subset R 
of IN 2 such that all decidable subsets of IN occur among the 
cross-sections R n = {# g IN | (n, x) 6 R}* 

5.15*. Show that there exists an enumerable set of natural 
numbers whose complement is infinite but does not contain 
an infinite enumerable subset (i.e., the complement is not 
computably infinite). 

5.16. Show that there exists a decidable subset R of IN 
such that the set {x |3 k £ IN (kx 6 R)} is not decidable. 

Exercises for Appendix A 

A.l. Prove that HA and B are not separable, then neither 
A nor B is decidable. 

A. 2. Show that there exist three enumerable sets A y B 
and C such that any two of them are disjoint but inseparable. 

A. 3. Prove that if A and B are enumerable subsets of IN 
and A [} B = IN, then A\B and B\A are separable. 
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A. 4. Show that there exist sets A, Be N such that 
there is no arithmetic set. which separates A from B. 

Exercises for Appendix B 

B.l. Prove that the projection of an arithmetic set on 
any set of axes (in the sense explained in Sec. 2) is an arith- 
metic set. 

B.2. Prove that the composition of arithmetic functions 
is an arithmetic function. Prove that if an arithmetic func- 
tion has an inverse, then that inverse function is arithmetic. 

B.3. Prove that any arithmetic function from N to M 
has an everywhere defined arithmetic extension. 

B.4. Prove that the class of arithmetic sets is the smallest 
class which includes the sets in Example 6 of Appendix B 
and which satisfies Lemmas B.1-B.4. 

B.5*. We define the quantifier depth of a formula as fol- 
lows: the quantifier depth of an elementary formula is 0, 
the quantifier depth of a formula of the form ~~|a is equal 
to the quantifier depth of a; the quantifier depth of a formula 
of the form (a /\ P), (a V P)> ( a -*■ P) or ( a *~* P) * s equal 
to the maximum of the quantifier depths of a and P; and 
the quantifier depth of a formula of the form 3£a or V£a 
is 1 greater than the quantifier depth of a. Prove that for any 
natural number k the set of true closed formulas of the lan- 
guage of arithmetic whose quantifier depth is no greater 
than k is an arithmetic set. 

B.6*. Prove that for any numbering of the closed formulas 
of the language of arithmetic and any numbering of the 
class formulas the two sets {n | the rath closed formula is 
true} and {(m, n> k) \ k is the number of the closed formula 
obtained as the result of substituting n in place of x x in 
the mth class formula} cannot both be arithmetic sets. 

Exercises for Appendix C 

C.l. Prove that the following functions are address- 
computable: 

(a) / (x) = 2*; 

(b) / (x, y)=*>; 

(c) / (x) = the #th prime number; 

(d) / (x) = the sum of the decimal digits of x; 
(e)* / (x) = the .zth decimal digit of e. 

C.2*. Show that the class of address-computable functions 
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from IN to IN would not change if we limited ourselves to 
some fixed number of registers, for example, if we did not 
allow any registers with numbers greater than 100 to be used 
in an address program. 

C.3. Show that the class of address-computable functions 
would not be enlarged if we allowed commands with register 
numbers given indirectly, that is, commands of the form 
R(a)+-R (R (b)) and R (R (b)) *- R (a). These commands 
say that the number in the register whose number is the 
number in register R (b) is transferred to the ath register, 
and conversely. 

C.4. Show that the following sets are weakly analytic: 

(a) {(x, y, z) | z = x y }\ 

(b) {(a;, y) \ x is the z/th prime number}. 

C.5. Prove that every weakly analytic set is analytic. 
(Show this without using the theorem on arithmeticity of 
weakly analytic sets.) 

C.6*. Prove that for any computable numbering of the 
words in A°° the numbers of the true statements of the 
language of arithmetic form an analytic set. 

C.7*. Show that the class of analytic sets does not change 
if we eliminate the two-place functional variables from the 
extended language of arithmetic. 

C.8* . Prove that if all functions are taken to be admis- 
sible, then the set of true closed formulas of the extended 
language of arithmetic is not analytic, but that if only the 
finite functions are taken to be admissible, then the set of 
true closed formulas is analytic. 

C.9*. We say that a set fc U h is address-enumerable 
if either it is empty or else there exist address-computable 
functions g ± , . ., gk from IN to !N, defined on all of IN, 
such that P = {(g 1 (n), . ., g k (n)) \ n 6 IN}. Prove (with- 
out using the protocol axiom) that the graph of an address- 
computable function is address-enumerable. 

CIO*. Prove (without using the program axiom) that 
there exists an address-computable function from N 2 to IN 
which is universal for the class of address-computable func- 
tions from IN to IN. 

Exercises for Appendix D 

D.l. Suppose that L = {a, &}, and our associative cal- 
culus is given by the substitutions a ++ aa, b «-► bb. Is this 
associative calculus decidable? 
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D.2. Prove that any associative calculus with a one-letter 
alphabet is decidable. 

D.3. Associative calculi are examples of the more general 
concept of calculi. This concept is perhaps as fundamental 
as the notion of an algorithm. The main difference between 
a calculus and an algorithm is that a calculus permits certain 
actions to be performed, whereas an algorithm prescribes 
such actions. If we replace two-sided substitutions by one- 
sided substitutions (which allow us to replace the left side 
by the right side, but not vice versa), then formulate a rule 
telling us which substitution should be formed and in what 
place in the word, and finally specify when the processing 
of a word will be considered to be complete, we are going 
from a calculus to an algorithm. (It is in this way that the 
normal algorithms used by A. A. Markov to prove the exis- 
tence of undecidable associative calculi are obtained). In 
this exercise we shall consider an algorithm which is some- 
what similar to this type. 

This algorithm is applicable to words in the alphabet 
{a, b}. It consists of the following instructions: 

(1) If the word begins with a, i.e., if it has the form aP, 
where P is a word, then transform it to Pb. 

(2) If the word has the form baP, then transform it to 
Paba. 

(3) Repeat these transformations until a word of the form 
aaP is obtained. At this point the algorithm ends, and the 
result of the algorithm is the word P. 

What happens if this algorithm is applied to the words 
babaa, baaba, and abaab'i 

D.4. Construct an algorithm which decides the associative 
calculus in the alphabet {a, b, c) which is given by the 
following substitutions: 

b «-► ace, 
ca «-► accc, 
aa «-* , 
bb ++ , 
cccc <-> , 

where the right side of the last three substitutions contains 
the empty word. 
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G. Answers and Hints for the Exercises 

In this appendix we shall give answers or hints for some 
of the exercises in AppendixT. 

2.2. See Sec. 3. 

2.3. If the graph of / is {(p (n), q (n)) \ n £ IN}, then 
/ (x) = q (the least n for which p (n) = x). 

2.4. See Lemma 6 in Sec. 3. 

2.5. If A = {/ (n) | n £ N} and^ b £ B, then B is the 
image of N 3 under the function g denned by setting 

g (k;Kn) = \ h ' if kh = f W> 

1 6, otherwise. 

2.6. See Corollary 1 of Lemma 4. 

2.7. If A = {/ (n) | n £ IN}, then ^4 is a projection of the 
set R = {(/(»), ») | » £N}. 

2.9. Suppose that the function / enumerates the set P. 
We can obtain the desired sequence p (0), p (1), . from 
the sequence / (0), / (1), . . by crossing out repetitions, 
i.e., discarding those / (n) for which / (n) = / (k) for some 
k <C n. 

2.11. Use Exercise 2.9 to write P as {p (0), p (1), .}, 
choose a computable monotonically increasing function (by 
discarding any terms which are less than earlier terms), 
and apply 2.10. 

2.12. Fix enumerations a and b of the sets A and B: A 

{a (i) | i 6 N}, B = {b (i) \ i £ N}. Consider the sequence 
a (0), 6 (0), a (1), 6 (1), . Put the numbers which first 
appear in the even places in the set A lt Put the numbers 
which first appear in the odd places in the set S x . 

2.13. Fix an enumeration of P. Then the value of / at x 
is the number y such that the pair (x, y) appears in the enu- 
meration of P earlier than all other pairs (x, z), i.e., all 
other pairs whose first element is x. 

2.14. In U 2 consider the set (A X {0}) U (B X {!}), 
and apply 2.13. 

2.15. Use 2.11 to prove 2° => 3°. 

2.16. We must construct a set / which does not contain 
a single infinite enumerable subset (see 2.15). The family of 
all infinite enumerable subsets is countable. Let W , W x , . . 
be all such sets. We shall construct J in steps, where in the 
fth step we arrange for W t not to be a subset of / and for / 
to contain at least i elements. At the zeroth step we choose 
an element a Q in W and agree that a will not be in /, there- 
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by ensuring that W cjz /. At the ith step we choose an 
element a t in W t which has not yet been included in J 
(this can be done, since W t is infinite, and only finitely many 
elements have been put in / in the course of the first i steps). 
By agreeing not to put a t in/, we ensure that W t (\z I. In 
order to be sure that / contains at least i elements at the 
ith step, we proceed as follows: we choose any i numbers 
which we have not yet barred from membership in / (this 
can, of course, be done, since only i + 1 numbers have 
been barred from membership in / when we're at the ith 
step). We take J to be the union of the finite sets of i numbers 
chosen at the ith step. 

2.17. The function / either is identically 1 or else is one 
of the functions g t , where 

[ 1 for x^i, 

All of these functions are computable. 

2.18. Yes, it is. If we compute e with increasing precision 
(for example, by means of the well-known series of reci- 
procal factorials), we sooner or later find out whether mln < e 
or mln > e. (Equality is impossible, since e is irrational.) 

2.19. Yes; see Exercise 2.18. 

2.20. It suffices to treat the case of irrational x, since all 
three conditions hold for rational x. 

2.22. The set of all real numbers is uncountable, whereas 
the set of all computable real numbers is countable, since 
the number of computable real numbers is no greater than 
the number of algorithms which compute them. 

3.1. See Lemma 6 in Sec. 3. 

3.2. This obviously follows from Exercise 3.1. 

4.1. The formula V e x n a can be replaced by the formula 
V x n (lx n even] ->- a). 

4.2. Consider all eight possibilities for the truth or falsity 
of the closed formulas a, p, 7. 

4.4. Use the relations in Exercises 4.2 (parts (1) (j), (k)) 
and 4.3 (part (b)). 

4.5. See Examples 1, 3, and 5 in Appendix B. 

4.6. See Appendix C. 

4.7. Any formula of the form (x = n) can be replaced by 
an equivalent formula with no numbers. For example, 
(x = 0) is equivalent to (x + x = x)\ (x = 1) is equivalent 
to (x-x = x) /\ ~](x + x = x)\ (x = 2) is equivalent to 
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3*/ ((y = 1) A ( x = V + y)) (where (y = 1) is replaced 
by the equivalent formula without the 1); and so on. 

4.8, The family of all arithmetic sets is countable, 
whereas there are uncountably many subsets of IN. 

5.1. See Corollary 1 of the protocol axiom. To prove that 
(a) ->• (b), note that the set of values of an everywhere 
defined function / coincides with the domain of definition 
of the function g defined as follows: g (n) = (the least k for 
which / (k) = n). 

5.2. See Exercise 2.13. 

5.3. This set is a projection of the set: 

(graph of /)(1(NX {1986}). 

5.4. If G is an everywhere defined function from !N 2 to N, 
then the function g defined by setting g (x) = G (x, x) + 1 
cannot be one of the functions G n . Hence G is not universal. 

5.6. If the set M = {x \ a (x) = 1986} were decidable, 
then the function p defined by setting 

( 1986, if x$M, 
P( * )== U if^M, 

would be a computable function which is everywhere dif- 
ferent from a. 

5.7. Let P be an enumerable undecidable subset of N. 
Then (P X {0}) U ((N\i>) X {1}) is the desired set. 

5.8. Let G be a computable function from IN 3 to N which 
is universal for the class of all computable functions from 
N 2 to N in the following sense: any computable function 
from IN 2 to IN occurs among the functions G n defined by the 
formula G n (x, y) = G (n, x, y). Consider the function F 
from W to IN which is defined by setting 

F (k, x) = G(l (k), t| (*) f *), 

where £ and r\ are the functions in the proof of Lemma 5 
in Sec. 3. This F will be the desired function. 

5.9. They are projections of the set (graph of /) and the 
set (graph of /) fl (N X N X {1986}). 

5.10. Let / be a computable function from IN to IN with 
undecidable domain of definition. Set 



(m, n) = I 



/ (rci), if m — n^ 

undefined, if m^n. 



5.11. Let K be an enumerable undecidable set. Then set 
P = (ZX{0}) UP {1}). 

5.12. TakeP to be the domain of definition of a computable 
function which is universal for the class of computable func- 
tions from IN to N. 

5.13. If Q = {x | (x, x) (J P) were an enumerable set, 
then it would coincide with P n for some n\ but this is impos- 
sible, since n £ Q <-* n (J P n . 

5.14. If R is a decidable subset of N 2 , then the set S 
defined by setting S = {x \ (x, x) $ R) is a decidable sub- 
set of N which is different from all cross-sections of R. 

5.15. The solution can be found in § 8.1 of Rogers' book 
(see Bibliography). 

5.16. Let p (0), p (1), ... be a listing of the elements 
in the enumerable undecidable set P. Then R = {(p (i)th 
prime number) l \ i £ N}is a set with the desired property. 

A.l. If A were a decidable set, then it would be a decidable 
set separating A from R. 

A.2. Take 4, B and C to be the sets {x \ a (x) = 0}, 
{x | a (x) = 1}, and { x \ a (x) = 2}, where a is a comput- 
able function from which no computable function can be 
everywhere different. 

A.3. Use Exercise 2.12. 

A. 4. A and R can be taken to be nonarithmetic sets which 
are the complements of one another in IN. 

B.3. For an everywhere defined arithmetic extension of 

the arithmetic function /, we can take the function / defined 
by setting 

~ . ( j{n)> Hf(n) is defined, 
1 0, if f(n) is undefined. 

B.4. If a class of sets contains the sets in Example 6 of 
Appendix B and satisfies Lemmas B.1-B.4, then it contains 
the sets which are associated with formulas of the type 
(t = s) and the sets which are associated with all formulas 
which are constructed in the various ways from the elemen- 
tary formulas, i.e., itpontains all arithmetic sets. (The proof 
uses induction on the length of the formula with which 
a set is associated.) 

B.5. Prove this by induction on k. It k = 0, the assertion 
follows because our set is decidable. The induction step 
from k to k + 1 proceeds as follows. Let R h be the set of 
true statements' having quantifier depth at most k. Let 
A h+1 and E h+1 be the sets of true statements of quantifier 
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depth at most k + 1 which begin with the quantifiers V 
and 3, respectively. Use arithmeticity of B h to prove that 
A h +! and £&+! are arithmetic. Then prove that B h+l is 
arithmetic. Note that as k increases the quantifier depth 
of the formula with which B h is associated also increases. 
It can be shown that this is unavoidable, i.e., the quantifier 
depth of any formula with which the B h is associated must 
increase without bound as k increases. 

B.6. Use the argument at the end of Appendix B. 

C.l. (a) Here is the required program: 

1 i?(l)+-0 

2 R{2) +- 1 

3 R(S) +- 2 

4 i?(4) -<- 1 

5 IF R(l) = R(0) GO TO 9 ELSE GO TO 6 

6 R(i)+-R(i) +R(A) 

7 R(2)+-R(2).R(3) 

8 GO TO 5 

9 R(0) +- R(2) 
10 STOP 

(c) The general plan for constructing the required address 
program is given by the following flow-chart: 



R (1)^-2, R (2)^-0 



~r 


no 




Is R (1) prime? 


R(l)<-R(\) + 1 





I ym 


yes 




R(2) = R (0)? 


i?(0) +-/?(!) 





R(2)*-R(2) + i 
i?(l)«-i?(l) + l 



STOP 



One can check whether R(l) is prime, for example, by run- 
ning through all numbers less than R(l) and determining 
whether R(l) is divisible by any of them. 



100 



(e) Use the reciprocal factorial series for e. 

C.2. A finite sequence of natural numbers can be repre- 
sented by a single number. Thus, the operation of an address 
machine with infinitely many registers can be modelled 
on a machine with only 100 registers, if one of the registers 
stores the entire memory of the first machine (represented as 
a single number) and the other 99 registers are used for the 
various computations needed to go from one machine to the 
other (such as coding the memory of the first machine by a 
single number, decoding that number, etc.). 

C.3. Using a technique similar to that in the hint for 
Exercise C.2, we can easily model indirect addressing. 

C.4. Use Exercise G.l and the arithmeticity of address- 
computable functions. 

C.5. The formula (for all finite v) a can be replaced by 

(for all v) ([v finite] -*- a), 

where [v finite] can be written as follows: 

3 XiV x 2 (v (x x + x 2 ) = 0). 

C.6. We have the equivalence: 

(the closed formula with «-► (there exists * a function 
number n is true) which assign$^|he value T 

or F to a&yxlosed formula 
of arithmetic, which has 
the properties indicated* in 
the definition of truth and 
which assigns the value T 
to the rath closed formula). 

C.7. Our computable function, which gives a one-to-one 
correspondence between N 2 and IN, is arithmetic. We can 
use this function to reduce two-place functions to one-place 
functions. 

C.8. Use an argument analogous to the proof of Tarskf s 
theorem. The second part of the problem is similar to Exer- 
cise C.6. 

C.9. Let all address programs be represented (coded) 
by natural numbers. Prove that, with a natural choice of 
such a coding, the function F from N 4 to IN which is given 
by setting F (n, x, y, k) — (the number in the yth register 
after the Zcth step of the address program with code n when 
applied to input x) is address-computable. (This function 
is obviously computable.) 
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CIO. See the hint for Exercise C.9. 

D.l. This calculus is decidable. Here is an algorithm 
which decides it. Suppose we are given words P and Q. In 
order to determine whether or not they are equivalent, 
replace all groups of repeating a's by a single a, and all 
groups of repeating b's by a single b. (For example, the word 
aaababbaa is transformed to ababa.) If the same word results 
for Q as for P, then they are equivalent; otherwise, they are 
not equivalent. 

D.2. Suppose that the calculus has the form 



a ni 


<-> 


a mi , 


a n * 


■*-► 


a m S 


a h 


«-► 


a m \ 



with mi =£ n t for all i\ let h t denote | m- f — /i f |; and let p 
be the smallest number among all the m^ and n t . Then no 
word of length less than p is equivalent to another word 
(since none of the substitutions can be applied to such 
a word), and the words of length m and n (where m, n^ p) 
are equivalent to one another if and only if m — n is divisible 
by g.c.d. (fy, . ., h k ). 

D.3. Ther word babaa is transformed to baaba (the algo- 
rithm produces a-result); the word abaab is processed to the 
word bbabab, and then the algorithm cannot be applied 
(the algorithm stops without producing a result); the word 
baaba is transformed as follows: 

baaba -> abaaba — >- baabab -> abababa ->■ bababab 

— >- babababa -* 

This process continues on indefinitely without stopping 
because the word ba . ba (with ba repeated n times) is 
transformed to the word aba . aba (n times), which is 
then transformed to ba ba (2n times). 

D.4. Every word in this calculus is equivalent to one of 
the words a, ac, ace, accc, the empty word, c, cc, or ccc (we 
shall call these eight words reduced words). We can use 
the substitution b ++ ace to remove all fc's, then use the 
substitution ca ++ accc to move all a's to the left of all c's. 
We can now use the substitution of the empty word for 
aa or cccc to ensure that there are at most 1 occurrence of 
a and at most 3 occurrences of c. 

We now prove that none of the reduced words are equiv- 
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alent to one another. We do this by letting every word cor- 
respond to a certain transformation of the square (i.e., 
a certain permutation of the vertices of the square). Namely, 
we let the word c correspond to a 90° rotation, we let the 
word a correspond to reflection about the center line parallel 
to one of the sides, and we let the word b correspond to 
reflection about the center line parallel to the other pair of 
sides. We let a word obtained by joining two words P 
and Q correspond to the composition of the two transforma- 
tions of the square corresponding to P and Q (in that 
order). It is not hard to verify that equivalent words corre- 
spond to the same transformation, and that the reduced 
words all correspond to different transformations. Hence, 
the reduced words are all inequivalent to each other. 

The following algorithm decides this calculus. To deter- 
mine whether or not two words P and Q are equivalent, 
first replace each by an equivalent reduced word, and then 
compare the two reduced words. If they are the same, then P 
and Q are equivalent; if not, then P and Q are inequivalent. 
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Few discoveries have had as much impact on our perception of 
human thought as Codel's proof in 1930 that any logical system, 
such as the usual rules of arithmetic, must inevitably be incomplete, 
i.e., must contain statements which are true but can never be proved. 
Professor Uspensky's book makes both the precise statement and 
also a proof of Codel's startling theorem understandable to someone 
without any advanced mathematical training, such as a college stu- 
dent or even an ambitious high school student. Also, Uspensky in- 
troduces a new method of proving the theorem, based on the theory 
of algorithms which is taking on increasing importance in modern 
mathematics because of its connection with computers. This book is 
recommended for students of mathematics, computer science, and 
philosophy, and for the scientific layman interested in logical prob- 
lems of deductive thought. 
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